Senior Python Developer (SQL & Cloud)

Develop and maintain Python-based applications and data pipelines.

Data Sourcing: Extract data from diverse repositories including relational databases (Oracle, PostgreSQL), NoSQL stores, file systems, and other structured/unstructured sources.

Data Transformation: Design and implement ETL/ELT workflows to standardize and cleanse data using best practices in data engineering.

Pipeline Development: Build scalable, fault-tolerant data pipelines that support batch and streaming use cases.

Design and implement cloud-native solutions using GCP services such as BigQuery, Cloud Functions, Cloud Storage

Data Format Expertise: Work with various data formats including JSON, CSV, and others.

Optimization & Monitoring: Ensure performance, reliability, and cost-efficiency of data pipelines through continuous monitoring and tuning.

Ensure code quality through unit testing, code reviews, and adherence to best practices

Document technical designs, processes, and configurations

Collaboration: Work closely with data architects, analysts, and business

stakeholders to understand data requirements and deliver high-quality solutions.

Proficiency in Python with experience in building scalable applications

Knowledge of microservices and architecture patterns

Strong SQL skills, including query optimization and data modeling

Hands-on experience with Cloud services (ideally GCP: BigQuery, Cloud Functions, Cloud Storage, etc.)

Familiarity with CI/CD pipelines and version control (Git)

Familiarity with data modeling, schema design, and metadata management.

Understanding of data warehousing concepts and ETL processes

Hands-on experience with BigQuery