Bangalore, India
2 years of experience as spark developer
0 Feedback
Local Time - 10:11 PM
About Me
Overall experience of 7.8 years including 2+ years of experience in big data development in spark with scala.
Roles & responsibilities:
Develop programs in Spark using RDDs, Spark SQL dataframes & datasets to handle structured, semi structured & unstructured data and implement Extract, Transform & LoadETL functionality.
Implement the CDC process type 1 & type 2 as per the business requirements.
Ingest the data from RDBMS to Hadoop cluster using SQOOP.
Convert the data in HDFS files to dataframes using Scala case classes.
Transform the data using various business rules in the mapping document using Spark SQL built in functions.
Query the data in Hive tables from Spark & load the data back to Hive from Spark dataframes created using transformations.
Once the dimensions and fact tables are loaded, generate the insights in the form of reports which the stakeholders are interested in.
Handling different formats of data like XML, JSON, CSV, TXT, AVRO, PARQUET format.
Explore & Appreciate my Work
Ajit Byatnal has not added any portfolio
My Project History & Feedbacks
My Endorsements
Ajit Byatnal hasn't been endorsed yet
My Education
Work Experience
Certifications
$6/hr
Total Earnings
$ 0
Projects Completed
0
Services Delivered
0
Buyer worked with
0
Feedbacks
0
Followers
Total Refund
0
Contest Completed
0
Member since
My Articles
No Articles Posted
Top Freelancers by city
Copyright © 2024 | Truelancer.com