Important Information
Location: Brazil
Job Mode: Full-time
Work Mode: Work from home
Job Summary
As a Data Engineer, you will play a crucial role in data modeling, transformation, and pipeline development, ensuring data is organized, accessible, and ready for analysis. You will collaborate closely with the customer, including BI and software engineering, to integrate and maintain high-quality data. This role is fundamental in driving the adoption of cloud data platform capabilities, particularly with tools like Google Cloud Platform (BigQuery), Fivetran, and dbt, and occasionally developing dashboards in Looker.
Responsibilities and Duties
- Responsible for creating and maintaining data applications and machine learning models;
- Deploy modern data solutions that interact with Generative AI and build APIs for delivering models and providing data access;
- Ensure that data is received, verified, transformed, stored and that it is accessible to the team;
- Build and promote data pipeline management and database maintenance;
- Gather and prepare data to be analyzed and worked on, correcting possible processing failures;
- Consume and transform data obtained from different sources (CSV, APIs, …);
- Add value by building, structuring and optimizing data to be used by analysts and users.
Essential Skills
- Python programming for data manipulation and analysis;
- ETL concepts and tools;
- Software Development background;
- Familiarity with data exploration tools;
- Hands-on experience in data engineering, preferably working with a modern cloud technologies (e.g. Snowflake, dbt, Fivetran, Databricks).
Highly Desirable Skills
- Experience with extracting, processing and modeling data;
- Experience in creating scripts for querying and manipulating data in SQL database;
- Experience in developing ETL routines (Data Extraction, Transformation and Loading);
- Experience in AWS Tools (AWS Glue, AWS Lambda, AWS Athena, AWS S3, AWS EC2);
- Hands-on experience in data engineering, preferably working with a modern cloud technologies (e.g. Snowflake, dbt, Fivetran, Databricks);
- Experience with streaming data and workflow orchestration i.e,. Kafka, Spark, Airflow, etc;
- Experience with creating and maintaining CI/CD pipelines (CircleCI, GitHub Actions).
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.