*instinctools is a software development company that provides custom software solutions for businesses of all sizes. Our team works closely with clients to understand their specific needs and provide personalized solutions that meet their business requirements.

*instinctools is looking for a Data Engineer (BigQuery) for one of our clients. 

Location: Ahmedabad, India (office format) 

Our Client is one of the TOP-5 global management consulting firms considered to be among the most prestigious ones in the world. Hundreds of customers from Fortune-500, including the largest global financial institutions, the world’s top media companies, technology companies and federal government agencies rely on our Client’s proven platform and services.

Project is a dynamic solution empowering companies to optimize promotional activities for maximum impact. It collects and validates data, analyzes promotion effectiveness, plans calendars, and integrates seamlessly with existing systems. The tool enhances vendor collaboration, negotiates better deals, and employs machine learning to optimize promotional plans, enabling companies to make informed decisions and maximize return on investment.

Stack on the project: BigQuery, SQL, and Apache Spark, Python, AWS

Tasks:

  • Build and optimize data pipelines using BigQuery, SQL, and Apache Spark
  • Design and implement scalable data processing systems
  • Manage and optimize data pipelines
  • Ensure the quality and efficiency of data flows
  • Collaborate with data scientists and analysts to support data initiatives

Our expectations of the ideal candidate: 

  • 5+ years of experience as a Data Engineer
  • Strong experience in writing and optimizing complex SQL queries, managing datasets in Google BigQuery, and ensuring efficient data retrieval
  • Ability to build, optimize, and troubleshoot distributed data processing pipelines using Apache Spark (PySpark/Scala)
  • Hands-on experience in designing, building, and maintaining scalable ETL/ELT pipelines, ensuring efficient data transformation and processing
  • Understanding of cloud-based data solutions, storage optimization, and performance tuning in AWS
  • Strong knowledge of data validation techniques, performance tuning, and monitoring to ensure high-quality, efficient, and reliable data flows

Soft Skills:

  • Ability to clarify requirements with the customer
  • Willingness to pair with other engineers when solving complex issues
  • Good communication skills

English: Upper-Intermediate or higher

Working time zone:
IST

We offer:

  • flexible working time (from Indian location)
  • professional and ambitious team
  • learning opportunities, seminars and conferences and time for exploring new technologies
  • co-funding for language courses (English)
Margarita Lukyanenka
Margarita Lukyanenka Recruiter
We will be glad to see you in our team!

    * Full Name

    * E-mail

    * Job Vacancy

    Additional Information (LinkedIn, Github, etc.)

    Developers

    *instinctools is a developer of IT solutions for Western Europe. We have over 350 projects in our portfolio. The spheres are different – from healthcare and medicine, training and education, to digital advertising, economics and IT. For the software implementation and maintenance across such a number of projects, competent developers are important.

    We use a modern technology stack, the key of which are:

    Javascript, ReactJS, Angular, Node.js, Golang, Python, Java, iOS, Android, Blockchain, AWS.

    Join the *instinctools team!

    *instinctools Poland
    We have had a representative office in Poland (Warsaw) since 2021. Our Polish team consists of highly qualified and experienced specialists – most of them are Middle to Senior level Developers.
    Right now we’re on the lookout for bright and innovative minds to join our professional team!