You are viewing a preview of this job. Log in or register to view more details about this job.

Junior Data Engineer

  1. Design, develop and modify software systems, using scientific analysis and mathematical models to predict and measure outcome and consequences of design
  2. Develop individual modules, test the functionality and integrate it with the main software build, Perform unit testing and functional testing of the product
  3. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  4. Understand existing software solutions if any and enhance the design as per requirements
  5. Understand the existing data model of various databases or any other data sources already deployed from the perspective of software development for a new and improved system
  6. Build technical solutions required for optimal ingestion, transformation, and loading of data from a wide variety of data sources using SQL and AWS technologies
  7. Integrate the data sources into the application, perform desired operations as per requirements and output the data to other sources as desired
  8. Perform thorough testing, profiling and validation to support the accuracy of data transformations and data verification used in the machine learning models
  9. Analyzing information to recommend and plan the installation of new systems or modifications of an existing system
  10. Analyze complex data systems and elements, data flow, relationships and dependencies to contribute to conceptual, logical and physical data models
  11. Understand and formulate processing pipelines of large, complex data sets that meet functional / non-functional business requirements
  12. Create and maintain optimal data pipeline architecture
  13. Maintenance and Bug fixes post deployment of the Software Product
  14. Store, retrieve, and manipulate data for analysis of system capabilities and requirements