職位描述
該職位還未進行加V認(rèn)證,請仔細了解后再進行投遞!
You will be reporting to the Engineering manager, you will work with Product Manager, other Engineering Team Members and with a variety of talented teammates. You will be part of team that will be a driving force in building Data and Analytic solutions for Technology.
Responsibilities:
1. Design and build reusable data assets for China data lake.
2. Anticipate, identify and solve issues concerning data management to improve data quality.
3. Clean, prepare and optimize data at scale for ingestion and consumption.
4. Implement complex automated workflows and routines using workflow scheduling tools.
5. Drive collaborative reviews of design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards.
6. Troubleshoot complex data issues and perform root cause analysis to proactively resolve product and operational issues.
7. Mentor and develop other data engineers in adopting best practices.
Requirements:
1. Above 4 years experiencing developing scalable data lake / data warehouse on top of big data platform.
2. Have deep Knowledge and experiences on Spark SQL / Hive SQL language, good knowledge of Presto or other MPP databases.
3. Have good experiences on Airflow or other data warehouse scheduling tools.
4. Have good experiences on data warehouse modeling.
5. Have good knowledge on AWS S3, EMR, lambda and AWS components or similar tech stack on other cloud.
6. Experiences on real time data processing, streaming data processing will be strong plus
7. Have experiences on Python programming
8. Strong skills building positive relationships across Product and Engineering.
9. Able to quickly pick up new programming languages, technologies, and frameworks.
10. Experience working in Agile and Scrum development process.
11. Fluent English skill (including oral and written English)
工作地點
地址:上海楊浦區(qū)上海-楊浦區(qū)三門路(地鐵站)


職位發(fā)布者
HR
國際商業(yè)機器全球服務(wù)(大連)有限公司

-
IT服務(wù)·系統(tǒng)集成
-
51-99人
-
私營·民營企業(yè)
-
高新技術(shù)產(chǎn)業(yè)園區(qū)五一路269號302
相似職位
-
外貿(mào)業(yè)務(wù)助理 面議浦口區(qū) 應(yīng)屆畢業(yè)生 不限東爵有機硅(南京)有限公司
-
招聘專員 6000-10000元浦口區(qū) 應(yīng)屆畢業(yè)生 本科漣水正邦牧業(yè)有限公司
-
澳林廣場-羅蘭音樂-市場顧問 面議浦口區(qū) 應(yīng)屆畢業(yè)生 不限南京澳林購物廣場有限公司
-
QC專員 (職位編號:008) 面議浦口區(qū) 應(yīng)屆畢業(yè)生 不限南京南大藥業(yè)有限責(zé)任公司
-
專職安全員 6000-8000元浦口區(qū) 應(yīng)屆畢業(yè)生 不限中交天和機械設(shè)備制造有限公司
-
2022/2021/2020屆畢業(yè)生 5000-8000元浦口區(qū) 應(yīng)屆畢業(yè)生 本科華天科技(南京)有限公司