Data Engineer(Data Scientist )

Career Area: Technology, Digital and Data Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.   Your Impact Shapes the World at Caterpillar Inc When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.   Job Summary We are seeking a skilled Data Engineer(Data Scientist) to join our Pricing Analytics – Enterprise Strategy - Global Financial Division Team . The preference for this role is to be based out of Brigade World Trade Center Office, Chennai, India What You Will Do:   As a Data Engineer on the Global Parts Pricing Data Engineering team, you will design and build scalable data platforms, pipelines, and cloud solutions that power pricing decisions across a global business. You will solve complex data challenges, transform diverse data sources into trusted and actionable insights, and deliver solutions that drive significant business outcomes. Working alongside data scientists, analysts, and business stakeholders, you will develop high-performance data products, automate critical processes, and help shape the future of data and AI-driven pricing determination.    Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources   Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability   Perform debugging, troubleshooting, modifications and testing of integration solutions   Operationalize the developed jobs, processes and models.   Create databases and infrastructure to process data at scale   Create solutions and methods to monitor systems and solutions   Automate code testing and pipelines  Engage with business partners to participate in design and development of data integration/transformation solutions per functional requirements.   Engage and actively seek industry perspectives through, continuous learning, peer groups, etc.     What You Will Have:  Data Pipeline Development: Ability to design, build, and optimize scalable batch and real-time data pipelines that deliver trusted, high-quality data for analytics, reporting, and AI applications.  Cloud Data Engineering: Experience with cloud-based data platforms, storage, and processing technologies; ability to develop resilient, scalable, and secure data solutions.  Data Modeling & Integration: Knowledge of data modeling, transformation, and integration techniques; ability to consolidate diverse data sources into well-governed, consumable data products.  Data Observability & Quality: Experience implementing data quality frameworks, monitoring, testing, and automated validation to ensure reliable and trusted data assets.  Collaboration & Business Impact: Ability to partner with cross-functional teams to understand business needs and deliver data solutions that support pricing decisions, analytics, automation, and AI-enabled outcomes.     Top Candidates Will Have:   Extensive experience in designing and developing software applications in Python.  Experience with AI assisted software development (ex. Github Copilot, Cursor, Codex, etc)  Extensive experience working with Git version control  Extensive experience deploying software using CI/CD tools such as Github Actions, Azure Devops etc.  Experience with AWS components such as Bedrock, Lambda, Fargate, S3, Sagemaker, IAM and RDS  Experience with databases such as PostgreSQL, Snowflake, Oracle, etc.  Demonstrated strong learning ability and a proactive approach to staying current with the latest technologies and industry trends. The position requires the candidate to work a 5-a day -week schedule in the office Shift Timing: EMEA Shift :01:00PM -10:00PM IST Skills desired: Business Statistics: Knowledge of the statistical tools, processes, and practices to describe business results in measurable scales; ability to use statistical tools and processes to assist in making business decisions. Level Working Knowledge: • Explains the basic decision process associated with specific statistics. • Works with basic statistical functions on a spreadsheet or a calculator. • Explains reasons for common statistical errors, misinterpretations, and misrepresentations. • Describes characteristics of sample size, normal distributions, and standard deviation. • Generates and interprets basic statistical data. Accuracy and Attention to Detail: Understanding the necessity and value of accuracy; ability to complete tasks with high levels of precision. Level Extensive Experience: • Evaluates and makes contributions to best practices. • Processes large quantities of detailed information with high levels of accuracy. • Productively balances speed and accuracy. • Employs techniques for motivating personnel to meet or exceed accuracy goals. • Implements a variety of cross-checking approaches and mechanisms. • Demonstrates expertise in quality assurance tools, techniques, and standards. Analytical Thinking: Knowledge of techniques and tools that promote effective analysis; ability to determine the root cause of organizational problems and create alternative solutions that resolve these problems. Level Working Knowledge: • Approaches a situation or problem by defining the problem or issue and determining its significance. • Makes a systematic comparison of two or more alternative solutions. • Uses flow charts, Pareto charts, fish diagrams, etc. to disclose meaningful data patterns. • Identifies the major forces, events and people impacting and impacted by the situation at hand. • Uses logic and intuition to make inferences about the meaning of the data and arrive at conclusions. Machine Learning: Knowledge of principles, technologies and algorithms of machine learning; ability to develop, implement and deliver related systems, products and services. Level Working Knowledge: • Completes specific tasks and initiatives utilizing machine learning technologies, such as search engine optimization. • Utilizes specific tools and techniques to process descriptive and inferential statistics. • Applies specific computing languages and tools in machine learning, such as R and Python. • Explores to use machine learning in one own areas to make business improvements. • Conducts data mining and cleaning initiatives. Programming Languages: Knowledge of basic concepts and capabilities of programming; ability to use tools, techniques and platforms in order to write and modify programming languages. Level Working Knowledge: • Participates in the implementation and support of specialized programming languages. • Conducts basic reviews on writing a specific programming language within a specific platform. • Assists with the design and development of specialized programming languages. • Follows an organization's standards, policies and guidelines for structured programming specifications. • Diagnoses and reports minor or routine programming language problems. Query and Database Access Tools: Knowledge of data management systems; ability to use, support and access facilities for searching, extracting and formatting data for further use. Level Working Knowledge: • Def