Dhruv Goel
Mentor
(3 reviews)
US$15.00
For every 15 mins
3
Sessions/Jobs
ABOUT ME
Experience Backend Developer with Cloud Expertise
Experience Backend Developer with Cloud Expertise
I'm a Python developer with experience in developing Cloud (primarily AWS) native applications. I have worked building data pipelines and scalable gateway services and also know how to deploy and operate them on the cloud.
I also have expertise in GNU/Linux internals and utilities.
Hindi, English
New Delhi (+05:30)
Joined July 2015
EXPERTISE
4 years experience | 2 endorsements
Python is my go-to language for programming needs. While I've worked with Ruby and Java in my work environment as well, I'm quite familia...
Python is my go-to language for programming needs. While I've worked with Ruby and Java in my work environment as well, I'm quite familiar with the whole Python ecosystem and popular libraries/frameworks. I also use Python for competitive coding practice.
4 years experience | 1 endorsement
Early in my career, I worked as a Devops Engineer and that exposed me to AWS in a lot of ways. I know my way around EC2, RDS, VPC - VPN c...
Early in my career, I worked as a Devops Engineer and that exposed me to AWS in a lot of ways. I know my way around EC2, RDS, VPC - VPN config, Lambda, and other AWS offerings.
4 years experience | 1 endorsement
I have worked on automating the creation and management of Kubernetes clusters. Also well versed in implementing security, monitoring, an...
I have worked on automating the creation and management of Kubernetes clusters. Also well versed in implementing security, monitoring, and scaling in a cluster.
4 years experience | 1 endorsement
3 years experience | 1 endorsement
4 years experience | 1 endorsement
2 years experience | 1 endorsement
REVIEWS FROM CLIENTS
(3 reviews)
Steven Reeves
May 2022
Genuine review, he went through everything with me and answered all my questions and made sure that I understood everything at the level of my understanding, would recommend.
Antuan Vazquez
January 2022
Dhruv impressed me with the level of granularity, specificity, and elegance that he was able to articulate his Kubernetes knowledge. The time I spend on a call with him was very effective and he surpassed my expectations. The scope of our interaction was Kubernetes only, but he did seem knowledgeable about other DevOps-related topics and AWS products.
EMPLOYMENTS
Senior Software Developer
Atlassian
2021-01-01-Present
I work as a Senior Software Developer in Atlassian towards scaling JQL Search Service. My team works towards maintaining a service that p...
I work as a Senior Software Developer in Atlassian towards scaling JQL Search Service. My team works towards maintaining a service that processes over 20 million requests per hour to downstream services and maintains an SLO of <1.2s for returning a response.
Java
Docker
Python 3
View more
Java
Docker
Python 3
Spring Boot
View more
Senior Software Engineer
Qubole
2017-07-01-2020-11-01
I worked at Qubole as a Senior Software Engineer in the Cloud Platform Team. My team's code was responsible for launching and maintaining...
I worked at Qubole as a Senior Software Engineer in the Cloud Platform Team. My team's code was responsible for launching and maintaining Big Data Clusters over the public cloud. Importing the customer's data and routing queries to these clusters while managing the resources for the clusters was an essential part of the process.
Linux
Bash
Amazon EC2
View more
Linux
Bash
Amazon EC2
Docker
Python 3
Amazon RDS
Kubernetes
AWS Lambda
View more
PROJECTS
Shuffle Data Migration Service
2020
EBS Volumes are used to store the data on AWS EC2 machines. Spot machines are used to save costs on large data clusters. But Spot machine...
EBS Volumes are used to store the data on AWS EC2 machines. Spot machines are used to save costs on large data clusters. But Spot machines can go away at short notice (Node1) and sometimes the processing has to be done at a new node (Node2) from scratch.
We can prevent this by reusing the data on Node1 if we can make YARN identify Node2 same as Node1. I used secondary network interfaces to identify node in YARN because I could reuse that property on a new node.
As soon as the Spotloss notification arrives, I issued a command to Yarn to stop scheduling compute operations on Node1.
I make Api calls to unmount disks and export logical volume and volume group data - Change attributes for EBS and NetworkInterface - Pass UserData Config to launch new node.
New node checks for availability and attaches the disks and network interface and gets registered in YARN and continues processing.
This process takes <2mins and GBs of data is preserved.
Bash
Amazon EC2
Python 3
View more
Bash
Amazon EC2
Python 3
View more