Principal Software Engineer

SUMMARY OF RESPONSIBILITIES

As a Principal Software Engineer, you will play a crucial role in leading development works in API Gateway using GraphQL, implementing schemas, types, queries, mutations and resolvers. Contribute to the overall architectural decisions related to the API gateway, ensuring it aligns with best practices, scalability, and maintainability. Collaborate with domain owners to define a cohesive and extensible system design.

KEY AREAS OF RESPONSIBILITIES

API Gateway Development:

• • Design, develop, and maintain the API gateway using GraphQL technology.
  • Ensure the gateway is robust, efficient, and scalable to handle incoming API requests and route them to appropriate services.

Performance Optimization:

• • Optimize the API gateway's performance and responsiveness by managing caching, batching, and optimizing resolver functions. Address bottlenecks and fine-tune the system for optimal execution.

Security and Authentication:

• • Implement security measures such as authentication, authorization, and data validation to protect sensitive data and ensure that only authorized clients can access certain resources.

Integration with Microservices:

• Work closely with Data team to integrate the API gateway with various microservices, ensuring seamless communication between services and maintaining consistent data retrieval and updates.

Error Handling and Logging:

• Implement robust error handling and logging mechanisms to capture and report errors, exceptions, and anomalies in the API requests and responses.

Documentation:

• Create comprehensive and up-to-date documentation for the API gateway, including API specifications, schemas, usage guidelines, and troubleshooting information

Code Reviews and Mentorship:

• Lead code reviews to ensure code quality, adherence to coding standards, and best practices.
• Provide guidance and mentorship to junior developers on GraphQL and API development concepts

FUNCTIONAL COMPETENCIES

Programming Languages:

• • GraphQL: Proficiency in defining GraphQL schema, types, resolvers to define the API’s data model, operations and behaviour. Have a good understanding on how to handle queries and mutations.
  • Optimize and structure the GraphQL schema to efficiently serve clients’ data needs.
  • Golang/Java: Expertise in at least one server-side language to implement your GraphQL server and handle business logic.

Data Storage and Querying

• • SQL and/or NoSQL Databases: Knowledge working with one of the popular databases is a must e.g. PostgreSQL, MSSQL, Oracle
  • AWS SDK/APIs: Know-how to manipulate AWS S3 buckets or other services and use the appropriate SDK for your programming language.
  • Parquet Format: Understanding the Parquet data format and how to efficiently read and write data in this format.
  • Data Partitioning: Knowing how data is partitioned can help in querying it more efficiently.

Data Streaming and Processing:

• • Kafka: Ability to stream data or consume data from Kafka using producers, consumers, and stream processing.
  • Kafka Connect: For moving data between Kafka and S3 or other systems.

AWS Services:

• • AWS IAM: To manage permissions and access to S3 and other AWS resources.
  • AWS Glue: For ETL jobs and schema discovery in the data lake.

API Development

• • Authentication and Authorization: JWT, OAuth, or AWS Cognito for securing API.
  • Rate Limiting: To prevent abuse of your API.
  • Logging and Monitoring: AWS CloudWatch, ELK Stack, or similar for monitoring API usage and performance.
  • API Testing: Tools and libraries for unit testing and integration testing.

Data Analysis

• • Statistical and Analytical Tools: Libraries like Pandas, Numpy for Python or equivalent in other languages.
  • Data Visualization: Basic knowledge of tools like D3.js or libraries like Matplotlib for data visualization

DevOps

• • Containerization: Docker for containerizing your applications.
  • CI/CD: Jenkins, GitLab CI, or AWS CodePipeline for continuous integration and deployment.

General Software Engineering Skills

• • Version Control: Git
  • Documentation: Good commenting practice and external documentation.
  • Agile Methodologies: Familiarity with agile development practices and tools like Pivotal Tracker.

Soft Skills:

• • Excellent collaboration skills to work closely with Data Engineers, Data Scientists, Analysts, and stakeholders.
  • Strong communication skills to effectively convey technical concepts to both technical and non-technical audiences.
  • Analytical and problem solving skills are crucial
  • Ability to work in multidisciplinary teams and collaborate on solutions
  • Ability to collaborate with cross-functional teams and promote a culture of knowledge sharing and continuous improvement.

QUALIFICATIONS & EXPERIENCE

Minimum Qualifications

• • Bachelor’s Degree in Computer Science, Information Systems Technology, or Software Engineering
  • At least 5-7 years of relevant experience in Information Technology, especially in a development role.
  • Relevant work experience in the Financial Services and/or Technology sectors would be an added advantage
  • Excellent in both English and Bahasa Malaysia