Solved: AWS Inspector issue : Service ‘Amazon Web Services Agent’ (AWSAgent) could not be stopped. Verify that you have sufficient privileges to stop system services.

AWS Inspector issue
“Service ‘Amazon Web Services Agent’ (AWSAgent) could not be stopped. Verify that you have sufficient privileges to stop system services.”

Solution:-

First check that you are running the AWS inspector installation as administrator. But if you are still getting error then it can be because the most recent Amazon Windows AMIs released on February 23rd include a driver that uses the same service name as the Amazon Inspector Agent. This causes Inspector Agent installations to fail with the above error message. Impacted versions of the Windows AMIs include Windows Server 2008 R2, Windows Server 2012, Windows Server 2012 R2, and Windows Server 2016.

Try fixing it with the remove script provided in below forum link after taking all the required backups.

https://forums.aws.amazon.com/ann.jspa?annID=5505

But if you are still getting error “EC2 Windows Utility Device’ not found” when you execute the remove script follow below steps.

  • Take snapshot image of the instance.
  • After taking snapshot image login to the instance and execute below command in powershell as an administrator to fix it. It will need reboot of instance.
$agentService = Get-WmiObject -class win32_systemdriver | Where-Object {$_.Name -eq 'awsagent'}
$agentService.Delete()
  • After running these commands reboot the instance and try installation of AWS Inspector again.

Solved: How to reset RDS master user password

In this post we will show you how to reset  the master user password of an RDS DB instance. The new password after reset will be effective immediately.

  • Go to your AWS RDS console.
  • Select the DB instance whose master password you want to change. Do note that the DB instance should be in available state and not in backing up or any other state.
  • Once you have selected the instance, select Modify from Instance Actions dropdown.

  • It will take you to a new page  :- Modify DB Instance: cloudvedasdb
  • Scroll down to the Setting section and look for New master password.
  • Enter the new password in the text box and at the bottom click on continue.
  • Finally click on Modify DB instance.
  • The new password will be effective almost immediately.

Must have skills for DevOps Engineer and Free methods to learn them

Many people have asked us how to become a DevOps engineer so in this post we will show you the skills and technologies which can get you there.

Before we start we should know what is “DevOps”. As you can see the word is combination of “Developer” and “Operations”. So a DevOps engineer is suppose to be a bridge between the development and operations processes.

Let’s see which skills do you need to become a DevOps engineer. In this post we will also discuss how you can acquire these skills for free. We have also mentioned some advanced paid courses which can help you acquire these skills quickly.

Skill 1 :-  Make Linux your friend.

Nowadays whole world is moving towards opensource, and Linux is the poster boy of opensource world.  Most of the new enterprise level tools and services are now compatible with Linux and people are adopting them fast. So, as a devops engineer you will definitely have to work on/with linux in your job. Even Microsoft has come up with their own Linux version. So, you can understand the importance of Linux. You can learn Linux for free from Linux Foundation courses. But, if you are short of time you can quickly learn Linux through this course Learn Linux in 5 days .

Skill 2 :- Learn scripting

Automation is a big part of a DevOps engineer job and you will be expected to automate mundane tasks. This will not only help you work efficiently but also improve the overall maintainability of your company’s setup. Easiest way to automate things is through scripting. You should learn either shell scripting on Linux/Unix or powershell on windows. Free source to learn scripting is Learn Shell. Else, you can check out this around 6 hours course on Shell Scripting to solve real-world problems like a pro.

Skill 3 :- Understand the Cloud

Companies are shifting to cloud like never before. Applications are being re-built to leverage the advantage of cloud computing. So it’s always good that you know cloud really well. AWS, Azure and GCP are three market leaders and it will be good to know about at least one of them. All these vendors have tons of free material on their sites which can help you learn their technology. Else you can checkout these awesome Udemy courses for AWS, Azure or GCP .

Skill 4:- Source code Management

Tools like git are used to manage the version of code base and avoid any conflicts in code. As a devops engineer you should have good understanding of tools like git or bitbucket since they will be useful in build phase. Later you will use them to build a codepipeline. One of the good source to learn git for free is Try Git. To become zero to hero of Git in hours, one of the best course is Git complete.

Skill 5 :- Configuration management

Configuration management is used to manage the state of your infrastructure. You can use them to patch your linux servers or manage the services.  Some of the tools in config management are Ansible, Chef and Puppet. To get basic understanding of Ansible the best free course is from Redhat called Ansible essentials. If you want to get deeper understanding you can try Mastering Ansible.

Skill 6: – Continuous Integration/Continuous Delivery

CI/CD is an important aspect in DevOps engineers job profile. As we are moving towards cloud automated deployments are now essential. They avoid human errors and are fast. You can learn tools like Jenkins for CI/CD. Jenkins will specially be very useful in building a codepipeline, you can learn it for free here. Since CI/CD consists of multiple tools we think that it’s better you learn it from a single source. We found course from Edward Learn Devops: Continuously Deliver Better Software  to have covered most of the topics.

Skill 7 :- Infra as a Code

The latest “in thing” in cloud is Infra as a Code. Yes you read it right, gone are the days where you have to buy the server, install OS and other softwares on it. With tools like Terraform or Cloudformation you can automate the build of your entire infrastructure in cloud right from VPC, Security groups,  servers etc. to application installation and configuration. To get basic free understanding of terraform you can learn it from Katacoda . If you want to deploy AWS Infrastructure using Terraform we found Edward’s another course on Terraform to be really useful. For cloudformation we found the free AWS cloudformation tutorials to be useful. If you are looking for advance practical guidance AWS CloudFormation Master Class is a good course.

Skill 8:- Containers

Servers are now shrinking every day. With the advent of VMs, hardware anyways became less important. Dockers, a containerization technology is taking it to one level up. Now with Dockers you can have a miniature copy of your OS image with the application code. Docker will only run for a few mili seconds when a query is executed and once it’s job is done it will just stop. If you want to learn Docker for free the best source is Play with Docker Classroom. To gain more advanced skills you can learn from Docker Mastery.

Skill 9 :-  Container orchestration

Tools like Kubernetes or Elastic container service (ECS) are used to manage cluster of Docker containers. These tools provides you mechanisms for deploying, maintaining, and scaling application. You can learn about Kubernetes with practical labs for free from Katacoda. For advanced knowledge of Kubernetes try the complete Kubernetes course.

Skill 10 : – Serverless

Technologies like AWS lambda are removing the need to manage the servers at all. You just have to upload you code in the AWS Lambda and set your run time environment. Rest all the issues of memory, CPU, OS patching will be taken care by AWS Lambda. It’s important as a DevOps engineer that you understand how the lambda works and how you can set it up. You can learn about AWS Lambda for free from this AWS Lambda Tutorial. For more advanced real world example you can refer how to build a serverless App with AWS Lambda .

We hope this post is helpful to you in understanding the skills which are important for a DevOps engineer and how you can master these skills. You can expect questions related to these skills in the interview of a DevOps Engineer.

How to Import SSL certificate in AWS Certificate Manager and apply on ELB

In this post we will show you how to apply an SSL certificate on an AWS ELB.

Image source aws.amazon.com

To use the certificate in ELB first we will have to import it in AWS Certificate Manager(ACM).

Currently ACM needs PEM files namely Certificate Body, Certificate Private Key and  Certificate Chain. You can check ACM SSL certificate pre-requisites here.

If you have the SSL certificate in .pem formats you can directly go to Step 7. Else if you have certifcate in .pfx or other format please follow from Step 1.

Step 1  As mentioned earlier ACM expects the certificates in PEM format. So we will first convert the certificates from pfx to pem format using openssl tool.

Step 2  Download the openssl binaries for windows of Linux from the links on openssl site.

Step 3 Once downloaded, install it. In our case we have installed the exe on windows.

Step 4 Go to the location where the OpenSSL is installed. In the bin folder you will find the openssl.exe . We will use this exe for conversion as per below commands. (You may need the import password you used while generation of SSL certificate)

Execute below command in windows command prompt(CMD) as an administrator.

C:\OpenSSL-Win64\bin>openssl pkcs12 -in "C:\OpenSSL-Win64\bin\test-cloud.cloudvedas.com.pfx" -nodes -out "C:\OpenSSL-Win64\bin\test\test-cloud.cloudvedas.com.pem"

Enter Import Password:

Step 5 In the above command with “-in” you provide location where your .pfx certificate is kept. In “-out” you define the destination where the newly created .pem file should be kept. You can create a pem file from other certificate formats like .cer, .der, .p7b etc. also using openssl. Just explore its help options and execute command as we have done above.

Step 6 Once the .pem file is created you can open it with notepad. It will have multiple certificates and a key in it.

Step 7 Now go to AWS ACM console and click on Import a certificate.

Step 8 In the  Certificate body enter the complete certificate with all digits as below. In it’s description it will have something like friendlyName.

-----BEGIN CERTIFICATE-----

hdshgdhsgjjdghweuiw123hjhd8

-----END CERTIFICATE-----

Step 9 Similarly enter the private key contents as below.

-----BEGIN PRIVATE KEY-----

deuiryfmvfv7682376ruifn3487tdfi58fvnf8g9

-----END PRIVATE KEY-----

Step 10 Similarly enter the Certificate Chain .

-----BEGIN CERTIFICATE-----

yeuiwye78689ywhyeyds85d76ctd7cx7c56x8

-----END CERTIFICATE-----

Step 11 Finally review and save the certificate.

Step 12 Now go to Route 53 > Hosted Zone and create a record set. Check this link if you want to create a new Hosted Zone.

Step 13 Once inside the hosted zone create a record set where you will basically map your friendly URL name (test-cloud.cloudvedas.com) to the load balancer with a CNAME. (refer image below)

Step 14 Now go to Load Balancer section and click on your ELB.

Step 15 Go to listeners tab and click on Edit.  Click “Add” and in the Load Balancer protocol select HTTPS. In the same window click “Change” option below SSL certificate.

Step 16 In the new window select Choose an existing certificate from AWS Certificate Manager (ACM), and then select the certificate that you created, from Certificate list. Finally click on Save.

Congrats! You have now applied a new SSL certificate to the load balancer. Do let us know in comments section if you have any query.

How to prepare for AWS Certified Developer – Associate certification exam

In one of our earlier post we have detailed about which AWS certification is suitable for you ?

If you have decided to go for AWS Certified Developer – Associate certification this post is for you.

If you are  an absolute beginner you can start with free labs from AWS . To practice further you can create free AWS account. These two actions will get you started on AWS.

Beware that if you go beyond free tier limits you will be billed. Best practice is to create a billing alert.  This alert can save you from unexpected bill shockers.

To further hone your skills you can either go for AWS classroom training or go for online courses. The classroom training will cost you from USD 800 to USD 2000. While the online courses can cost you from USD 10 to USD 300, depending on which course you choose.

Our personal opinion is that you should go for online courses as they are cheaper and if you follow their labs honestly they can be as good as classroom training.

In online courses we recommend two providers acloudguru and Linux Academy.  Both have monthly plans to buy the courses but they can become bit costly if you can’t complete the course in 1 month.

We have observed that acloudguru also provide the same course on Udemy where you get lifetime access to course with just one time payment. Also, Udemy provide heavy discounts on courses during sale which can get you a good bargain.

Thus, we recommend this AWS Certified Developer – Associate course  of acloudguru on Udemy . Also, once you buy this course on Udemy you will get access of the same course on acloudguru website also.

The acloudguru course instructor Ryan is an industry expert and deliver the course really well. The course will cover almost all the main topics which are asked in exam.  (Though we have observed that as of Apr-18 it was missing a session on AWS lambda for which the questions have started appearing in exam. Hope they update the course soon.) Currently you can learn about lambda from Ryan’s other course on AWS Lambda .

It’s a good idea to follow all the labs with the instructor and once you get confidence redo the labs independently. Don’t forget to complete the practice quizzes to check your knowledge.

This course will give you good base for the exam. But, the course itself is not enough to clear the exam.  You should go through whitepapers and FAQs of atleast below service .

  • EC2
  • S3
  • SQS
  • RDS
  • DynamoDB
  • Lambda

Exam pattern

Exam has Multiple-choice and multiple-answer questions. Exam is of 80 minutes.

Practice Exam Questions

To get a good evaluation of your preparation you can go through another course of  acloudguru sample exam questions on Udemy  .  Many test takers have said that they got similar questions in exam.

Exam Cost

Exam will cost you USD 150. AWS also gives you an option to book a practice exam for USD 20 before you go for actual exam.

How to book exam

To book an exam you will have to create an account in AWS Training and Certification Portal .

Passing score

AWS doesn’t reveal minimum passing score and it keeps on changing. But we have observed that generally people who score above 80% passed the exam. You will immediately see the score on you screen once you finish the test and will also get a report on your mail within 1 hour.

Exam Tips

  • Get good sleep and keep calm during the exam.
  • You won’t get more than 3 mins per question.
  • You may find some very long questions in exam. Best strategy to tackle them is to read the answer options first and than check for relevant info in question.
  • Since it’s an AWS exam so look for AWS related options in the answers.  Chances are high that  Non-AWS related option in answer will be wrong.
  • AWS exams generally don’t focus on mugging their datasheets. So you won’t get a question like “How much RAM does a C3.xlarge offer?” .

That’s all folks! Best of luck for the exam!

Do let us know in comments section if you have any query.

Solved: Restore root disk of EC2 without changing IP or Hostname

If the root volume of your EC2 instance got corrupt, instance won’t come up. Since you don’t have access to console of EC2 instance so you can’t do much.

In this post we will discuss options to restore an EC2 instance from snapshot backup. Prerequisite for the below guide is that you already have snapshot of the volume which you want to restore.

Option 1 – Different IP and Hostname 

Easiest option to restore an EC2 instance is to launch a new instance with the available snapshot. Refer this AWS doc to launch an instance from backup.

But, an instance launched this way will have both hostname and private IP different from original instance. If this is a problem for you go to option 2.

Option 2 – Same IP different Hostname

So, as per option 1 you have created and instance with an AMI but now you need the IP to be same as old one. To go around this you can detach the network interface of old instance and attach it to new instance.

This option will give you same private IP as old one but you will still have new hostname.

If you need both hostname and IP to be same go to option 3.

Option 3 – Same IP and Hostname

In this option we will discuss how you can restore an EC2 instance and keep both hostname and IP same. This can very important if your EC2 instance is in Active Directory(AD) domain, as change in IP and hostname mapping will cause conflict in domain. Because of this conflict the domain server can block login to the EC2 instance.

Let’s see how we can get around this.

Prerequisites:-

  • You already have snapshot of the root and other volumes of instance.
  • Keep a screenshot of your Instance description from your AWS console, this can be used to refer instance configuration later.

Plan

For the eager one’s, plan is to follow the below steps.

  • Stop the instance
  • Detach the current root EBS
  • Create a new volume from the old snapshot
  • Attach the new volume to instance
  • Boot the instance

Now let’s see the steps in detail.

Stop Instance

Stop the instance if it’s up.

Detach the current root EBS 

  • Select the root volume(/dev/sda1) mentioned as “Root device” from instance description and click on EBS id of the volume.
  • You will now come in “Volumes” window.
  • From the “Actions” drop down select “Detach Volume”

Create a new volume from the old snapshot

  • Create a volume from the snapshot you have taken earlier.
  • Select the snapshot of the volume and from “Actions” drop down select “Create Volume”.
  • In the “Create Volume” window ensure that you select the Availability Zone to be same as the AZ in which your instance is located.
  • Leave the other options as default. (refer image)

  • Finally hit “Create Volume”.

Attach the new volume

  • Once your volume is created select it.
  • From the “Actions” drop down select “Attach”.
  • While attaching the volume in the device field mention volume name as /dev/sda1 since we are attaching it as root volume. This is same as your old root volume name.

  • Hit “Attach” .

Boot instance

  • Once the volume is attached start the instance normally. You should now see that the instance has the data from your old backup. Also, it’s hostname and private IP will remain same as before.

Note:- If you want to keep the public IP to be fixed, you need to assign an Elastic IP to the instance. Public IP assigned by default, by AWS keeps on changing with every reboot.

That’s all folks!

How to prepare for AWS Certified Solutions Architect – Professional

Hello!

In this post we will discuss how to prepare for AWS Certified Solutions Architect – Professional certification.

Pre-requisite

Only pre-requisite to appear for the professional exam is that you clear  AWS Certified Solutions Architect – Associate certification.  You can check here about how to prepare for associate certification.

Once you have cleared the associate exam you can start preparation of  AWS Certified Solutions Architect – Professional certification.

Many of the topics in the professional exam are same as that of the associate exam. So in professional exam you may actually see few questions are repeated from associate exam itself.

But still it has a lot of new topics also. Below are the topics on which you can expect most questions in exam.

Exam Topics

  • VPC
  • EC2
  • S3
  • Amazon Elasticache
  • Redshift
  • Cloudfront
  • Elastic Transcoder
  • AWS Data Pipeline
  • RDS
  • Cloudsearch
  • EMR
  • DynamoDB
  • SQS
  • CloudTrail
  • KMS
  • Kinesis
  • Opsworks
  • Auto Scaling
  • ELB
  • VPC peering
  • Direct Connect
  • Cross Account Access

Preparation

As you can see the list above contains a wide range of topics and reading about them can be overwhelming. You can also see the official exam blueprint here . It is good if you have at least 1 year of experience with these AWS technologies.

You can start your preparation by attending AWS  classroom training or you can go for online courses. I personally liked the contents of two online courses one was from acloudguru and  other from linux academy .

Both the courses are good but I chose acloudguru course as the course allowed you lifetime access. While for linux academy you have to pay monthly fee. I knew that with full-time job it may take me more than a month to prepare for this exam so I decided to opt for the acloudguru course.

The acloudguru course is comprehensive and the trainer Ryan covers the topics in a decent way. The course alone is not enough to clear the exam but it will give you a good understanding of the exam topics.

Apart from the course you should also refer to the AWS FAQs  which are very helpful during scenario based questions.

Also Linuxacademy gives you 7 days free trial so you can use that period to do their practice exams which also has lot of good questions.

Exam pattern

  • Multiple choice and multiple answer questions.
  • You will be given scenarios and questions will be based on that. Only few will be direct questions.
  • Exam will be of 170 minutes
  • And you can expect approx 80 questions

Cost

Exam cost is USD 300

You also have an option to appear for practice exam from Amazon. It costs you USD 40. Many people have told me that the actual exam is easier in comparison to the practice exam. So, if you score good in practice exam you can be sure about your preparation.

Sample Questions

You can refer to some sample exam questions here and on Udemy.

Hope the above info is helpful to you. Do let me know if you have any query.

Best of Luck for the exam!

Solved: ERROR: current transaction is aborted – Redshift

Problem:-

[Amazon](500310) Invalid operation: current transaction is aborted, commands ignored until end of transaction block;

Solution:-

If you are getting the above error while you are connected to Redshift, ensure that you have checked the “Autocommit” box below the “Password” box in SQL Workbench/J connection window. (refer image below)

Once you check the “Autocommit” box try connecting to the Redshift cluster again.

Review of acloudguru course AWS Certified Solutions Architect – Associate

In this post we are writing a review of acloudguru course  AWS Certified Solutions Architect – Associate on Udemy .

When I decided to go for AWS Certified Solutions Architect – Associate exam I was confused about how to start with preparation. Syllabus of the exam is vast and covers a lot of topics. I needed someone to guide me for this exam.

After going through many forums I came to the conclusion that I’ve two options.

  1. To attend the course at one of the training institutes. The official training cost range from $800 to $1500. Even the institutes offering non-official training quoted $400 to $900. This was huge money considering that my last company was not sponsoring this course and I have to pay for it myself.
  2. Second option was to look for online courses. These course are cheap ranging from $10 to $100 but I was not sure about the quality of content and how much I can learn with just online training.

After going through multiple forums and blogs I ended up listing online courses from two vendors  Linux Academy and acloudguru.

Linux Academy has good material and people have written some good feedback for them. But the problem with them is that you have to buy their monthly subscription with plans starting from $29. I knew that with a full-time job I won’t be able to complete the course properly in 1 month.

So I checked on acloudguru course.  Many people have given good feedback for this course too. The course was listed on acloud.guru website for $29. But I found the same course on Udemy for $10 in a special offer at that time. Udemy also provides you free lifetime access to the course. I found this was most suitable for me so purchased it. Also once you buy the course from Udemy you can get free access to the same course on acloud.guru website also.

Now coming to the acloudguru  AWS Certified Solutions Architect – Associate course itself.

As of Apr-2018  course has around 22 hours of on-demand video.

The course is very comprehensive and it gives you a good understanding of topics. Instructor(Ryan) is very energetic and he tries to teach you the topic in a very simple way. So even if you don’t have background in AWS then also you will understand the topics with not much effort.

It covers a lot of practical labs which you can follow by creating your own AWS free tier account.  It covers almost all topics of the exam. So you don’t have to worry about the syllabus.

It also has quizzes in between the course for knowledge check and also full length mock exams to test your understanding.

One of the recommendation for the exam preparation is to go through the white papers. Each of the white paper is a big pdf of 50 to 200 pages. And for the associate level you are supposed to read around 6 to 7 of them. This can be overwhelming but Ryan cover the gist of these whitepapers in his course.

The course is very useful to get you started on the AWS journey.  But the course alone is not enough to clear the exam.  You need to have good practical knowledge of AWS for clearing the exam and this course give you the correct direction.

You can get good sample exam questions for practice from another course of acloudguru on Udemy  Exam Questions – AWS Solution Architect Associate or from Jon AWS Certified Solutions Architect Associate Practice Exams for which most students have written great feedback.