Data Engineer | Databricks, AWS, PySpark & SQL
Data Engineer | Databricks, AWS, PySpark & SQL
Detalhes do trabalho
Local de trabalho
["Sao Paulo"]
Função do cargo
Technology Analyst - Brazil
Percurso profissional
Estado/Região/Província
Sao Paulo
País
Brazil
Habilidades
Others (Please specify in the Requisition notes)
Domínio
Delivery
Grupo de interesse
Infy Brazil
Empresa
INFOSYS TECNOLOGIA DO BR
ID da requisição
155908BR
Competências técnicas 1
Competências técnicas 2
Competências técnicas 3
Competências técnicas 4
Competências técnicas 5

Infosys Brazil is looking for professionals with a Data Engineer | Databricks, AWS, PySpark & SQL profile to join our team.


Required Qualifications

  • Strong experience in Data Engineering and Databricks environments.
  • Hands-on experience with AWS, Databricks, Python, PySpark, and SQL.
  • Advanced knowledge of Python and PySpark.
  • Strong knowledge of SQL and relational and dimensional data modeling.
  • Experience with Databricks and Delta Lake, including jobs, workflows, and Medallion Architecture.
  • Experience with ETL/ELT processes and data pipeline migration.
  • Knowledge of AWS services for Data Engineering, including S3, Glue, EMR, Athena, Lambda, DMS, and Step Functions.
  • Experience with Azure Synapse.
  • Knowledge of data quality, testing, and reconciliation processes.
  • Experience with Git and CI/CD practices.
  • Advanced English communication skills.
  • Strong communication and interpersonal skills.



Preferred Qualifications

  • Knowledge of DataStage for pipeline analysis and reverse engineering.
  • Experience with Data Warehouse-to-Lakehouse migration initiatives.
  • Knowledge of Unity Catalog, including permissions and data lineage.
  • Knowledge of Data Mesh, data products, and federated data governance.
  • Experience with observability and monitoring of data platforms.
  • Knowledge of FinOps concepts applied to Databricks, including DBUs, clusters, and compute policies.
  • Knowledge of Delta Sharing and data contract standards such as ODCS.
  • Experience in financial services or credit environments.



Roles and Responsibilities

  • Develop and maintain scalable batch data pipelines using PySpark and Python.
  • Build data transformations and support relational and dimensional data modeling.
  • Build and operate Databricks and Delta Lake pipelines using Bronze, Silver, and Gold architecture.
  • Migrate and modernize legacy ETL pipelines using Spark, CDC, and batch ingestion.
  • Support the reverse engineering of Azure Synapse pipelines and SQL Pools.
  • Implement automated testing, data quality controls, and data reconciliation processes.
  • Apply Git and CI/CD practices to data pipeline development and deployment.
  • Collaborate with technical and business teams to deliver reliable and scalable data solutions.

Additional Information
Employment Type

  • Full-time, permanent position (CLT).


Work Model

  • Hybrid.


Benefits

  • Transportation allowance.
  • Meal voucher.
  • Childcare assistance.
  • Life insurance.
  • Funeral assistance.
  • Medical insurance.
  • Dental insurance.


Career Opportunities

  • Opportunity to work on global projects and international environments.
  • Exposure to Software Quality Assurance and project governance practices.
  • Collaboration with multicultural and cross-functional teams.
  • Professional development within a global technology organization.


Language Requirements

  • Advanced English proficiency required for interaction with international teams and stakeholders.

Additional Required Qualifications

• Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• This position may require relocation and/or travel to work/project location.
• Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.

Additional Details

About Us
Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem.

EEO
Infosys provides equal employment opportunities to applicants and employees without regard to race; color; sex; gender identity; sexual orientation; religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability.

Compartilhar
Vagas semelhantes
Entre em contato conosco