AWS Cloud Engineer

AWS Cloud Engineer - MDM (Master Data Management)

Build high-performance, low-latency APIs for:

• Creating and updating data
• Searching and filtering attributes
• Managing identifiers, relationships, and metadata
• Use Amazon API Gateway (HTTP/REST APIs) and AWS Lambda or container-based runtimes.
• Implement caching layers (API Gateway cache / Redis via ElastiCache) for performance.

Data Layer (PostgreSQL)

• Develop normalized & optimized PostgreSQL schema,
• Implement indexing, partitioning, materialized views, and query tuning.
• Create CDC-based sync for downstream systems as needed.
• Ensure ACID consistency for transactional workloads.
• Real-time Ingestion,

Build real-time pipelines using:

• API Gateway + Lambda
• Implement idempotency, deduplication, and real-time validations.

Security & Compliance

• Implement authentication/authorization using:
• AWS IAM
• API Keys / OAuth2
• Ensure encryption, auditing, logging, PII compliance (POPIA/GDPR).

Observability & Performance

• Implement monitoring using CloudWatch dashboards, X-Ray tracing.
• Optimize API performance
• Scale PostgreSQL using Aurora PostgreSQL, read replicas, and connection pooling.

CI/CD & DevOps

• Build secure pipelines using:
• Azure,
• CloudFormation,
• docker

Core Technical Skills

• AWS API Gateway (REST/HTTP), Lambda, Step Functions, EventBridge, SQS, SNS, PostgreSQL,
• PostgreSQL performance tuning & schema design
• js / Python for API development
• AWS serverless and container-based architectures (Fargate/ECS)
• AWS Glue, S3, Glue Catalog, batch ETL

MDM concepts: MUST HAVE

• matching, deduplication, golden record
• Performance tuning at API, DB, and network layers
• Experience in building microservices or APIs using Docker containers