Flex Data Engineer

Hello Everyone,

We at #CosMicIT are looking for a #Flex Data Engineer 

Mode of working : Remote

Job Description:

Requirements:

● Minimum experience: 8-15 years

● In-depth knowledge and experience of GCP Data services : Bigquery / Dataproc / Composer / Pubsub / Datafl ow / GCS/ BigTable

● Must have profi cient experience in GCP Databases : Bigtable / Spanner / CloudSQL / AlloyDB

○ Solid understanding of relational database concepts and technologies such as SQL, MySQL, PostgreSQL, or Oracle.

○ Hands-on experience with other cloud platf orms and services such as AWS RDS, or Azure SQL Database.

○ Experience with NoSQL databases such as MongoDB, Scylla, Cassandra, or DynamoDB is a plus.

○ Familiarity with database performance tuning, optimization, and troubleshooting techniques is a plus

● Strong working experience on one or more of the Bigdata/Hadoop distributions( or ecosystems ) like, Cloudera/Hortonworks, MapR, Azure HDInsight, IBM Open platf orm, Kafk a, Hive, Spark etc

● Good understanding of the following AWS Data services, Redshift , RDS, Athena or SQS/Kinesis

● Good understanding of Native and external tables, with diff erent fi le formats : Avro, ORC, Parquet

● CI/CD pipelines for data workloads using Cloud Build, Artifact Registry, Terraform

● Data governance solutioning using GCP governance tooling (Dataplex, Data Catalog) Tools and languages experience Required Must have

● GCP Datafl ow, Pub/Sub, Cloud Composer, Cloud Workfl ow, BigQuery, Cloud Run, CloudBuild

● Must have: programming knowledge and willingness to be hands-on – Python, Java

● Specialization on streaming such as PubSub or Kafk a or equivalent Good to Have

● Experience in BigQuery or Presto or Equivalent
● Experience with open source ecosystem and distributions such as Hadoop, Spark, Cloudera/Hortonworks and frameworks and tech such as SPARK, Oozie, Kafk a, HBASE

● Understanding and experience with NoSQL databases such as HBASE, MongoDB, Cassandra,

● Knowledge of cloud databases such as Spanner, BigTable, Cloud SQL, DB migrations

Certification

● Good to have GCP Data engineering

Please share any profiles matching these requirements.

If any of these openings sound familiar to you or any of your known networks, please share the resume/CV to CV@cosmic-it.com

Any references would also be accepted.

Regards,

CosMicIT GmbH, Germany 

CosMicIT Informatics India Pvt Ltd. 

CosMicIT Spolka Z Ograniczona Odpowiedzialnoscia, Poland

www.CosMic-IT.com | www.CosMic-IT.in

https://www.linkedin.com/company/cosmic-it

#resume #connections #jobopening #hiring #jobseekers #jobs #recruitment #jobsearch #job #hr #recruiting #references #recruiters #opentonetwork #hiring #jobopening #experience #CosMicIT #indiajobs #india