Big Data Engineer

Cegeka currently has an exciting opportunity for a Big Data Developer for a Telecom Project to join us in Bucharest.

Cegeka uses Agile software development as an approach to deliver the highest value to the customer - we work in intense and close cooperation with the customer. You’ll be working in an established and proven environment, with quality-oriented developers.

Responsibilities:

• Develop, deploy, maintain / operate, test and evaluate big data solutions within Orange Romania organization.

• Collect, store, process and analyze of huge sets of data

• Choose optimal solutions to use for above purposes, then maintaining, implementing and monitoring them • Integrate solutions with the architecture used across the company

Requirements:

• Programming experience, ideally in Python, Spark, Kafka or Java and a willingness to learn new programming languages to meet goals and objectives.

• Knowledge of data cleaning, wrangling, visualization and reporting, with an understanding of the best, most efficient use of associated tools and applications to complete these tasks.

• Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.

• Knowledge in configuring & troubleshooting of all the components in the Hadoop ecosystem like Cloudera, Cloudera Manager, HDFS, Hive, Impala, Oozie, YARN, Sqoop, Zookeeper, Flume, Spark, Spark standalone, Kafka (incl. Kafka Connect), Apache Kudu, Cassandra, HBase

• Develop and maintain documentation relating to Hadoop Administration tasks (upgrades, patching, service installation and maintenance).

• Understand Hadoop’s Security mechanisms and implement Hadoop Security (Apache Sentry, Kerberos, Active Directory, TLS/SSL).

• Understand the role of Certificate Authorities, the setup of Certificates and their configuration in relation to Linux and TLS/SSL

• Work and continuously improve the DevOps pipeline and tooling to provide active management of the CI/CD processes

• Should have experience in scripting for automation requirement (. scripting via Shell, Python, Groovy etc.) • Understanding of networking principles and ability to troubleshoot (DNS, TCP/IP, HTTP).

Nice to have:

• Knowledge of one or more of the following: ElasticSearch, Kibana, Grafana, git/scm, Atlassian Suite (Confluence, Jira, Bitbucket) Jenkins/TeamCity, Docker and Kubernetes is highly appreciated

• NoSQL databases, MongoDB

• Integration with RDBMS, lambda architectures – integration of Data Warehouses – Data Lakes – Data Hubs • Cloud implementations of Big Data stacks

• Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O

Values Required:

• Positive attitude

• Team-player

• Willing to learn and improve

• Good problem-solving skills

• Flexible to different technologies and projects

What we offer:

• Flexible working environment within a dynamic team

• We leave you room to balance your work and private life - 22 days as annual vacation + additional vacation days according to the internal policies

• Access to various training programs (soft and hard skills trainings, according to the internal policies)

• Continous learning and improvement activities (reading groups, competency centers, video sessions on Pluralsight, Events: process related-Agile/Scrum/Kanban, coding oriented TDD Kata)

• Private medical subscription, you can choose from 2 providers

• Meal tickets

• Free Gym Subscription - fitness, aerobic, pool (according to internal policies)

• Massage within the company premises

• Team events (teambuildings, team hangouts, Christmas party, etc.)

• Long term career development programs

• Being part of a growing organization with Belgian roots