Big Data Engineer

Do you want to solve some of the hardest problems for business leveraging ML/AI? Do you want to learn how to build algorithms that scale ? most of our use cases start with 10 million+ rows of data.

We are looking for a Big Data Engineer to create solutions suitable for the job in a real-time, highly data-driven organization and make technical innovation happen. With a broad range of projects to develop data processing applications, you will have the opportunity to use cutting-edge technology across all stages of the lifecycle to support our projects related to NLP, data science models and marketing promotions.

Our data scientists & engineers are helping to shape our marketing strategy for a digital world.

Join us to do the best work of your career and make a profound social impact as a Big Data Engineer on our Growth Marketing team in Portugal.

What you?ll achieve
You will work with other engineers and data scientists to solve some of the hardest business problems. You will learn what it takes to build, deploy & scale ML/AI models in real-world (it?s a hard problem, we assure you). You will build analytical data sets on which model?s will be built. This would entail two key tasks ? feature engineering on large datasets and optimization of our pipelines to drive scalability. If you are already good at it, we will make you better.

You will

• 
  Feature engineering: Stitching together and aggregation of multiple large data sets working with the data scientist to a desired format. You will need to optimize both queries and architecture to support big data sets. SQL is usually the preferred language, but some NoSQL or Spark jobs are necessary.
• 
  Implement complex Data pipelining / ETL process: Once the initial dataset are prepared, it is normally run through a further pipeline to prepare it for modelling. Here you will create features that make ML/AI algorithms work (e.g., translating text into category variables). Python/R is usually the preferred language.
• 
  Develop and maintain documentation.
• 
  Producing ad hoc datasets and reports.

Take the first step towards your dream career
Every Dell Technologies team member brings something unique to the table. Here?s what we are looking for with this role:
Essential Requirements

• 
  Intermediate SQL & Python/R skills.
• 
  Education (Bachelor?s degree or higher) in Computer Science, Mathematics, or a related technical field, or equivalent practical experience.
• 
  Proven ability to work with varied data infrastructures ? including relational databases, column stores, Json format.
• 
  You have professional experience. 1+ years of experience in Data or BI engineering dealing with large complex data scenarios.
• 
  Experience of ETL and data processing.
• 
  Experience working in an Agile environment and SCRUM methodologies.

Desirable Requirements

• 
  Experience with data processing software (such as Hadoop, Spark, Pig, Hive), along with data processing algorithms (MapReduce, Flume).
• 
  Experience with stream data processing tools such Kafka, RabbitMQ.

Here?s our story; now tell us yours

Dell Technologies helps organizations and individuals build a brighter digital tomorrow. Our company is made up of more than 150,000 people, located in over 180 locations around the world. We?re proud to be a diverse and inclusive team and have an endless passion for our mission to drive human progress.
What?s most important to us is that you are respected, feel like you can be yourself and have the opportunity to do the best work of your life - while still having a life. We offer excellent benefits, bonus programs, flexible work arrangements, a variety of career development opportunities, employee resource groups, and much more.
We started with computers, but we didn?t stop there. We are helping customers move into the future with multi-cloud, AI and machine learning through the most innovative technology and services portfolio for the data era. Join us and become a part of what?s next in technology, starting today.
You can also learn more about us by reading our latest Diversity and Inclusion Report and our plan to make the world a better place by 2030 here.
Dell is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at Dell are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. Dell will not tolerate discrimination or harassment based on any of these characteristics. Dell encourages applicants of all ages. Read the full Equal Employment Opportunity Policy here.

Estrutura de cargos: Data-Science-&-Analytics Graduados Engenharia

Job ID: R154852