Senior Data Engineer
Are you ready to apply your knowledge and background to exciting new challenges?
Are you ready to apply your knowledge and background to exciting new challenges?
Description
Description
Job Title: Senior Data Engineer
Location: Remote in Europe
Contract Type: Permanent or Freelance (Full time)
Reference number
006
Overview of the company
Challenging and innovative is the best way to describe The Pineapple Corporation. Here you will find a professional challenge that will allow you to learn and grow in every way. We stand for innovation and “outside the box” thinking in order to develop new Artificial Intelligence technologies. Our goal is to deliver the best service to our customers and also let our employees to achieve their professional purposes.
Introduction
We are looking for a Senior Data Engineer with experience in technological projects. As a Data Engineer you will collaborate closely with our customer, Project Manager and IT team, to understand their needs, challenges, goals, and stablish robust data systems. You will be accountable for the technical oversight and maintenance of the end-to-end lifecycle of a data assets.
Description of the position
This is a full-time role for a Senior Data Engineer at ThePineappleCo, with flexibility for remote work. As a Senior Data Engineer, you will be responsible for designing, building and maintaining robust and scalable data systems. You will work closely with multidisciplinary teams to understand data requirements, implement technical solutions, and ensure the integrity, availability, and security of the data. Your experience in handling large volumes of data and your knowledge of cutting-edge tools and technologies will be essential for the position.
Responsabilities
- Collaborate with project leader and IT team to understand data-related project objectives and requirements.
- Develop efficient and reliable data pipelines for the ingestion, transformation, and loading of data from various sources.
- Implement solutions for data processing and analysis in real time and batch.
- Ensure the quality and cleanliness of the data, as well as the integrity and consistency throughout the entire data life cycle.
- Optimize the performance and efficiency of data systems to ensure fast and reliable access to information.
- Guarantee the security and privacy of data, implementing protection measures and regulatory compliance.
- Research and evaluate new technologies, tools, and solutions to continually improve data infrastructure capabilities.
- Provide guidance and technical leadership, ensuring data engineering best practices.
Profile Requeriments
- University degree in computer science, engineering or related field.
- More than 5 years of experience as a Data Engineer in technology projects or similar environments.
- Extensive experience in the design and implementation of data pipelines and storage solutions.
- Solid knowledge of technologies and tools related to Big Data, such as Hadoop, Spark, Kafka, NoSQL, among others.
- Familiarity with programming and scripting languages, such as Python, Java or Scala.
- Experience in the use of SQL databases and query optimisation.
- Knowledge and experience in agile methodologies and ability to work in multidisciplinary teams.
- Excellent problem solving skills and ability to tackle complex technical challenges.
- High level of english is required. Spanish is a plus
