Overall experience of 7.8 years including 2+ years of experience in big data development in spark with scala. Roles & responsibilities: Develop programs in Spark using RDDs, Spark SQL dataframes & datasets to handle structured, semi structured & unstructured data and implement Extract, Transform & LoadETL functionality. Implement the CDC process type 1 & type 2 as per the business requirements. Ingest the data from RDBMS to Hadoop cluster using SQOOP. Convert the data in HDFS files to dataframes using Scala case classes. Transform the data using various business rules in the mapping document using Spark SQL built in functions. Query the data in Hive tables from Spark & load the data back to Hive from Spark dataframes created using transformations. Once the dimensions and fact tables are loaded, generate the insights in the form of reports which the stakeholders are interested in. Handling different formats of data like XML, JSON, CSV, TXT, AVRO, PARQUET format....

To designing, develop, test, and maintain Big Data solutions, data management, processing systems of an organization. To ensure that the Big Data architecture of a company meets the client/business requirements. To design and develop highly scalable, efficient, robust & fault-tolerant Big Data systems and solutions. To identify and discover new and potential data acquisition opportunities. To implement complex Big Data projects by gathering, parsing, managing, analyzing, interpreting, and visualizing large datasets to extract valuable insights and convert those insights into actionable business decisions. To work in close collaboration with all the stakeholders involved in a Big Data project. To improve the quality, reliability, and efficiency of data, individual components, and the Big Data system as a whole. To create and innovate efficient Big Data solutions by integrating multiple programming languages and Big Data tools. To develop data models that can reduce system complexities,...

Hello, I am a professional backend software developer with ample industry experienceworked with Oracle, Amazon & fashion industry startup. I am skilful at programming languages : C, C++, Java, Scala. I have worked both with small scale and large scale real time and offline systems which give me solid experience of identifying correct tech stack for designing building software solutions. I have built web apps from scratch which has allowed me to have grip on solutions like Spring MVC, REST APIs, OLTP, mySQL & Spark.I also have knowledge and hands on experience on Git and few AWS services including S3,EC2, EMR, Athena & Glue. I have taken responsibilities as POC for multiple projects involving 3rd party clients and have handled the projects end-to-end. I am self-motivated and believe that good, clear and timely communication between me and my client plus proper documentation since the onset of project helps greatly in smooth progress with minimum blockers throughout the project....

Experience with developing softwares and applications for almost three years...

Data Scientist and IBM certified specialist professional in SPSS Modeller with 2 year of experience in executing data-driven solutions in banking domain to increase efficiency, accuracy, utility of internal data processing and building machine learning models algorithms to deliver insights and implement action-oriented solutions to complex business problems. Strong post graduate professional with a Masters in computer science [Msc] focused in big data analytics and business intelligence from S.K.Somaiya college, Mumbai...

I am a B. Tech Electronics Graduate with 1.5 years of freelancing experience building web applications/REST services over AWS server less framework. I have interned in 42 Silicon Valley, Fremont, CA working on real world software application projects. I have mentorship from industry leaders, senior Software Engineer working in top 10 tech companies. I can work in areas: 1.Java, Scala, Python Spark jobs on AWS EMR- desigining/architecting/monitoring/tuning. I can help you reduce your AWS bill and wait for data pipelines by 40%. 2. Mobile app backends supporting high volume data ingestion, CRUD APIs with custom business logic and ML models hosted for real time API. We can help you reduce API call latency of AWS based EC2/severless arch + cold starts and reduce your bill do well by 30%. 3. Building, tuning a customer facing searching experience on top of enterprise data catalogue, on elastic search stack. I can help you incorporate ML via data attributes and click login....

I have 3 years of experience in Angular 6, 7, 8, 9 and Java 8, 9, 11 with different types of databases as Mongo DB, and PostgreSQL. Also I am fluent with DevOps tasks as CI/CD and Deployment on S3 and Jenkins....

Hi I am Rahul Sable, working on big data domain from last 3 years. I am passionate to learn now technologies in big data & handle challenging work....

Working with a service company for 3 years. Have experience in web development and data engineering. Have delivered 3 client project with the team in current company. Now I want to work on a more interesting project. I have dreamed of having my own development company....

5+ years of experience in Machine learning and Big data technologies. stack: hive, Kafka, impala, kudu, hbase, phoenix, spark, spark structured streaming, clickhouse, Hadoop languages :scala, python, R, Bash databases: SQL, kudu, hive, mongo, Cassandra Ml: regression and classification...