Data engineer with exposure in the information technology and services industry. Worked on Hive,Pig,Sqoop,Scala,Spark,SQL,Oozie,Shell scripting,Bit bucket repository and Jira...

Hi, I am an individual with 2 years experience in Java development and python in data science. along with that I have done courses and have adequate knowledge and interest in Video Editing and Game testing too....

I am a senior big data developer with extensive experience in - Spark, Hive, Hadoop and Scala programming....

IT Professional with overall 15+ years of experience, worked with multiple domains and technologies....

Highly motivated Software Engineer professional having 2+ years of experience in Big Data and Hadoop technologies, mainly in Analysis and Application Development....

I have an experience of 8 years as a data analyst in ETL technologies....

This is Raj. I have 10+ years of experience IT experience which includes System Analysis and Design, Development & Support of Big data tools and ETLSSIS,Informatics,Talend etc. and reporting tools in different areas Health care ,Financial and industrial,Telecom communication,Oil and gas.Experience in development of solutions for Big Data using the Hadoop eco system technologiesHDFS,Hive,Impala,Sqoop,Oozie,MapReduce,Apache Spark,Kafka,Cassandra,Nifi,Azure,Scala,Pysaprk,AWS,Azure,Data Bricks,Data lake....

This is Venkatesh, Having 5.2 of experience on Big data, Hadoop, Spark, No-SQL, Cloud and Machine learning. Worked on multiple industries like Telecommunications, Server side, Banking and Retail. Technologies which i worked on : Bigdata, Hadoop, Spark, Scala, PySpark, Hive, HDFS, Kafka, NiFi, ELK, Cassandra, Hbase, MySQL, linux, ETL, Databricks, ML Flow, RabbitMQ, JMeter, Putty, winScp, Cloud based: AWS, GCP. Data distributed cloud on premises: Cloudera, Hortonworks. Datascinece: Machine learning, Deep learning algorithms and NLP....

Overall experience of 7.8 years including 2+ years of experience in big data development in spark with scala. Roles & responsibilities: Develop programs in Spark using RDDs, Spark SQL dataframes & datasets to handle structured, semi structured & unstructured data and implement Extract, Transform & LoadETL functionality. Implement the CDC process type 1 & type 2 as per the business requirements. Ingest the data from RDBMS to Hadoop cluster using SQOOP. Convert the data in HDFS files to dataframes using Scala case classes. Transform the data using various business rules in the mapping document using Spark SQL built in functions. Query the data in Hive tables from Spark & load the data back to Hive from Spark dataframes created using transformations. Once the dimensions and fact tables are loaded, generate the insights in the form of reports which the stakeholders are interested in. Handling different formats of data like XML, JSON, CSV, TXT, AVRO, PARQUET format....

To designing, develop, test, and maintain Big Data solutions, data management, processing systems of an organization. To ensure that the Big Data architecture of a company meets the client/business requirements. To design and develop highly scalable, efficient, robust & fault-tolerant Big Data systems and solutions. To identify and discover new and potential data acquisition opportunities. To implement complex Big Data projects by gathering, parsing, managing, analyzing, interpreting, and visualizing large datasets to extract valuable insights and convert those insights into actionable business decisions. To work in close collaboration with all the stakeholders involved in a Big Data project. To improve the quality, reliability, and efficiency of data, individual components, and the Big Data system as a whole. To create and innovate efficient Big Data solutions by integrating multiple programming languages and Big Data tools. To develop data models that can reduce system complexities,...