PySpark Developer

Sadup Softech Pvt Ltd

Professional experience with a cloud platform

Developer must have sound knowledge in Apache Spark and Python programming.

Deep experience in developing data processing tasks using pySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.

Ability to design, build and unit test the application in Spark/Pyspark.

In-depth knowledge of Hadoop, Spark, and similar frameworks.

Ability to understand existing ETL & logic to convert into Spark/PySpark/ Spark SQL.

Knowledge of Unix shell scripting, RDBMS, Hive, HDFS File System, HDFS File Types, HDFS compression codec.

Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources.

• Experience

  4 - 10 Years

• No. of Openings

  1

• Education

  Any Bachelor Degree

• Role

  PySpark Developer

• Industry Type

  IT-Hardware & Networking / IT-Software / Software Services

• Gender

  [ Male / Female ]

• Job Country

  India

• Type of Job

  Full Time

• Work Location Type

  Work from Office