Data Engineer and Architect for Beetleware

Data Engineer and Architect
Minimum 7 + years of hands-on experience working on Hadoop eco system. Proficient in Java, Python and Linux Scripting. Must have good knowledge in any of the scheduling tools.
The Ideal candidate must have experience in cloud-based Big data solution (in Azure, or AWS, or Google).
Entire end to end extract load and transform pieline including data lineage techniques
Able to design data lake aritecture with data retention and data pipeline (For Architect)
Hands-on experience with cloud based Big Data solutions on Azure or AWS or Google or Oracle Cloud
Strong knowledge of Hadoop, HDFS, Java, Map Reduce
Hands on experience in Sqoop, HiveQL, Impala & SparkQL
Deep knowledge on working with Spark Datasets, RDD and performance tuning
Strong SQL knowledge and ability to understand a large complex SQL statement
Linux Shell Scripting, Automation with Python
Good exposure to CI/CD pipeline
Good to have Docker and or kubernates hands on experience ( for data engineer)
send your cv