Big Data Architect - Frankfurt & Remote!
- Contract
Dieses Stellenangebot ist nun abgelaufen. Bitte sehen Sie sich ähnliche Rollen unten an...
We are searching for a Big Data Architect (m/w/d) for our data science consultancy client. They are working for an end-client in the transport industry.
The project duration is 3.5 months and it will be remote. The project language is German.
Project description
This particular project is focusing on the development and expansion of a data storage, processing and analysis platform (Datalake). This mainly involves machine or sensor data of trains. The aim is to view and evaluate the existing architecture and to show optimisation potential, especially with regard to performance, stability, compatibility, costs and sustainability.
Service description
- Assessment of the current Datalake architecture according to defined, comprehensible criteria with the involvement of other internal experts and users of the platform
- Deduction of recommendations for the further development of the Datalake platform by naming concrete technologies/tools
- Elaboration and written documentation of the advantages, possible disadvantages and challenges of using the recommended technology stack (target image). This also includes a differentiation from technologies that are not favoured but are customary on the market in this context.
- Derivation of a potential migration path from the current technology stack to the target image. Indication of special challenges/pitfalls that could arise in the context of migration
- Organisation and implementation of workshops, especially for the transfer of knowledge
Must-Have skills:
- Structured approach
- Strong analytical and conceptual skills
- Architecture and implementation knowledge of the AWS stack (e.g. ECS, EMR, Athena, Glue, Redshift, Kinesis or MSK, Lambda, Python)
- Architecture and implementation knowledge of the Hadoop Hortonworks stack (e.g. Spark, Kafka, HDFS, Yarn, Hive)
- Development and implementation of concepts for data preparation and data integration (engineering) in the AWS environment
- Presentation know-how
Nice-to-have skills:
- Architecture and implementation knowledge of relational databases, SQL, ETL and BI tools
- Project management expertise
If you are interested in this vacancy, we would be pleased to receive your updated CV, availability and your hourly rate with everything included.
Please feel free to contact me if you have any questions!
ähnliche Jobs
Gehalt
Negotiable
Ort
Berlin (10117), Berlin
Sector
IT
Location
Berlin
Company - Germany
Harvey Nash
Job Type
Contract
Beschreibung
Für unseren Kunden in Berlin suchen wir einen freiberuflichen SAP SSAM Entwickler (m/w/d). #ZielUpgrade des SAP Service & Asset Managers auf Version 2310Überführung bestehender SAP HAT custom apps in
Referenz
BBBH104911_1711445099
Verfallsdatum
01/01/0001
Autor
Anni VuAutor
Anni VuGehalt
Negotiable
Ort
Berlin (10117), Berlin
Sector
IT
Location
Berlin
Company - Germany
Harvey Nash
Job Type
Contract
Beschreibung
Für unseren Kunden in Berlin suchen wir einen freiberuflichen Coaching FGL Portfolio Steuerung (m/w/d). Eckdaten:Start: asapEnde: 21.10.2024Auslastung: 90 PT (mit Option zur Verlängerung)Einsatzort: 5
Referenz
BBBH104896_1711384244
Verfallsdatum
01/01/0001
Autor
Anni VuAutor
Anni VuGehalt
Negotiable
Ort
Berlin (10117), Berlin
Sector
IT
Location
Berlin
Company - Germany
Harvey Nash
Job Type
Contract
Beschreibung
Für unseren Kunden in Berlin suchen wir einen freiberuflichen Coaching FGL Programm Supporter (m/w/d). #Eckdaten:Start: asapEnde: 21.10.2024Auslastung: 90PT (mit Option zur Verlängerung)Einsatzort: 50
Referenz
BBBH104894_1711383724
Verfallsdatum
01/01/0001
Autor
Anni VuAutor
Anni Vu