Desenvolvedor de Dados II

Desenvolvedor de Dados II page is loaded Desenvolvedor de Dados IIlocations: Sao Paulo, Braziltime type: Full timeposted on: 今天刊登time left to apply: 結束日期︰2025年11月11日 (應徵期限︰2 天)job requisition id: JR-2025-18402Air Products 的宏圖是將人們聚集在一起，重新思考世界的可能性，並共同協作且創造出創新解決方案，以應對全球能源和環境永續發展挑戰 成為全球最安全、最多樣化且獲利最多的工業氣體公司，與我們一同迎接明日建設，一同成長。重新構想無限可能Join Our Global Team as a Data EngineerOur data lake empowers data scientists, business analysts, and IT professionals to undertake advanced analytics projects and business reporting. As a Data Engineer, you'll play a crucial role in transforming data models and algorithms into actionable insights, driving the success of our enterprise initiatives.This role is responsible for creating, managing, and documenting data flows from various sources leveraging batch, near real-time, and streaming data ingestion patterns to ensure delivery of high-quality data into our enterprise data lake. You will work closely with data scientists, analysts, and other data consumers to productionize data models and algorithms, enhancing the efficiency of advanced analytics projects. Throughout each stage of the process, you will implement the appropriate data quality, governance and security steps, ensuring data is ready to use by the enterprise.If you're ready to make a global impact and take your career to the next level, apply now and become a key player in our data-driven journeyPrincipal Accountabilities Data Pipeline Development: Design, construct, test, and maintain highly scalable data management systems.* Data Integration: Integrate structured and unstructured data from multiple data sources into a unified data system, ensuring data quality and consistency leveraging tools such as Qlik Replicate, Spark, Glue and Python.* Data Warehousing: Build and maintain data warehouses and data lakes to store and retrieve vast amounts of data efficiently.* Data Processing: Implement data processing frameworks (e.g., Spark) to process large datasets in real-time or batch processing.* Automation and Monitoring: Automate manual processes, optimize data delivery, and develop data monitoring systems to ensure data integrity and accuracy.* Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and provide technical solutions that meet business requirements.* Data Governance: Ensure data governance policies are followed, including data security, data privacy, and compliance with regulations.* Performance Tuning: Optimize the performance of ETL processes, databases, and data pipelines to handle large volumes of data and reduce processing times.* Project Management: Drive projects from the design phase through delivery and handover.QualificationsEducation: 4-year College Degree required; Bachelor’s Degree in Information Technology or related technical discipline preferred.Experience: Python, PySpark, building scalable real-time streaming ETL applications and data warehouses.* Advanced proficiency in PySpark and Python ETL modules.* Experience with large data sets in a time-sensitive environment.Technical Skills: Proficient with AWS tools (S3, Glue, Lake Formation, Athena, Redshift).* Experience with infrastructure as code using Terraform.* Advanced understanding of SQL and NoSQL technologies (e.g., MongoDB/DocumentDB).* Hands-on experience with Qlik (Attunity) Replicate.* Experience with DatabricksAdditional Skills: Solid understanding of data warehouse design patterns and best practices.* Ability to develop test plans and stress test platforms.* Experience with complex job scheduling.* Strong process development, adherence, and improvement skills.* Effective analytical, conceptual, and problem-solving skills.* Organized, disciplined, and task/goal-oriented.* Ability to prioritize and coordinate work based on high-level goals and strategy.* Effective team player with a positive attitude.* Strong oral and written English communication skills.* Coordinating work across multiple teams/resources is a plus.Air Products 是全球最大的氫氣生產商，擁有超過 80 年的工業氣體生產經驗。作為氫氣和工業氣體專家，Air Products 提供安全的端到端解決方案，大規模投資真實和潔淨的能源專案，並推動產業向前邁進，為未來創造更潔淨的環境。Air Products 將工作環境安全性放在首位，其文化中蘊含多元性和包容性，因此每位員工都能在 Air Products 找到歸屬感和其自身的重要性。欲瞭解更多資訊，請造訪 About Air Products 頁面。Register for Job Alerts Follow these simple steps: 1) Register by clicking ‘Join our Talent Network’ at the top of this page, where you can create your account. 2) Sign up for ‘job alerts’ to stay informed of vacancies based on your skillset and location preferences.More than 23,000 passionate, talented and committed employees from diverse backgrounds are driven by Air Products’ higher purpose to create innovative solutions that benefit the environment, enhance sustainability and reimagine what's possible to address the challenges facing customers, communities, and the world. J-18808-Ljbffr

Location: São Paulo, São Paulo, BR

Posted Date: 11/17/2025