IDB Invest - IT Associate / Senior Associate - Data Engineer
Location: Washington, DC.
The IDB Group is a community of diverse, versatile, and passionate people who come together on a journey to improve lives in Latin America and the Caribbean. Our people find purpose and do what they love in an inclusive, collaborative, agile, and rewarding environment.
About this position
IDB Invest is seeking a Data engineer, with strong technical skills, to join a team of staff and consultants in the data management and analytics office. The data engineer will work closely to implement large-scale data ecosystems including data management, governance, and the integration of structured and unstructured data to generate insights leveraging cloud-based platforms.
The position requires a highly motivated and versatile candidate with strong technical knowledge, and extensive data management skills on the latest tools and platforms to join the data team responsible for technical deliverables to provide business decision-makers with information upon which they can make more accurate and effective decisions across multiple domains. The data engineer’s primary responsibility will be to use best-practice data integration techniques to connect data modelers and support the needs of data scientists and/or data-intensive analytical applications.
Our Team: Data Management and Analytics is the team under the AKI Division that is responsible to define and implement the data strategy for IDB Invest.
What you’ll do:
- Propose and review cloud architectures for the data ecosystems that meet best practices in terms of cost, security, scalability, and evolution.
- Design, develop, and launch extremely efficient and reliable data pipelines to move data and provide intuitive analytics to our partner teams.
- Serve as a technical focal point to other data engineers and contractors. Support his colleagues by reviewing code and designs.
- Collaborate with other engineers and Data Scientists to discover the best solutions.
- Drive operational efficiency by maintaining their data ecosystems, sourcing analytics expertise, and providing As-a-Service offerings for continuous insights and improvements.
- Diagnose and solve issues in our existing data pipelines and envision and build their successors.
- Monitor, diagnose, and solve issues related to cloud costs to make sure that costs are within budget.
- Work together with data analyst to model data for staging into a data warehouse and architect data warehouse multidimensional models.
- Integrate new data management technologies and software engineering tools into existing structures.
- Create custom software components (e.g. specialized UDFs) and analytics applications.
- Building data pipelines to collect data and move it into storage, Preparing the data as part of an ETL or ELT process.
- Work with complex technical data stores such as relational databases, Azure BLOB, Azure Data Lake store, and MS Azure DW.
What you'll need
- Education: Master's degree (or equivalent advanced degree) in computer science, data science, software engineering, information systems, or related quantitative field relevant to the responsibilities of the role for the Senior Associate role. Bachelor’s degree or equivalent for the Associate role.
- Experience:
- At least 3 years of progressive experience.
- Working as a data engineer.
- Minimum 2+ years’ experience working as Databricks platform administrator.
- Experience with multiple database platforms.
- Experience in Cloud Technologies such as Microsoft Azure Data Lake Storage (ADLS) and Azure Datawarehouse (DW), working with an MPP system.
- Ability to design, build, and deploy data solutions that capture, explore, transform, and utilize data to support AI, ML, and BI.
- Knowledge of data mining, machine learning tools, such as Databricks.
- Knowledge of data governance solutions such Collibra will be considered a plus.
- Languages: Proficiency in English and one of the other Bank official languages (Spanish, French, or Portuguese) is required.
Key skills
- Learn continuously.
- Collaborate and share knowledge.
- Focus on clients.
- Communicate and influence.