Role: Big Data Architect
Exp in architecting highly scalable, distributed systems using different open source tools as well as designing and optimizing large, multi-terabyte data warehouses. Able to integrate state-of-the-art Big Data technologies into the overall architecture
Data Collection Methodologies and capable of extracting data from heterogeneous database, web sources or APIs
Designing and implementing fast and efficient data acquisition using Big Data processing techniques and tools.
Must have experience in recommendations to improve the effectiveness of Big Data systems, descriptive analytics systems and prescriptive analytics systems.
Experience in designing, reviewing, implementing and optimizing Data Transformation & Modeling processes in the Hadoop ecosystem. Able to consolidate, validate and cleanse and model data from a vast range of sources – from applications and databases to files and web services.
Agile SCRUM, Agile Iterative, Test Driven Development
Java, J2ee, Scala, Python
Spark, Kafka ,Hive, Sqoop ,HBase, Phoenix , Hue, Oozie, Airflow, Apache Kylin, Hadoop Distribution: Hortonworks(HD Insights)
AWS , Azure
You may be interested in these jobs