Udacity Cloud DevOps Nanodegree / Use Jenkins to check and store a simple html file to AWS S3
- Project Setup
- in IAM create a new Group
- this group should have the following policies:
- Amazon EC2 Full Access
- Amazon S3 Full Access
- create a new user, who as has console and programmatic access
- add this user to group created before
- Prepare AWS Ressouces
- create a new key-pair to be able connect via SSH to the EC2 instance, which will be created afterwards
- In EC2 --> Key-Pairs --> Create key pair
- copy this key to the machine from where the new EC2 instance will be accessed
- set the permission of this key to read-only chmod 400 my-shiny-new-key.pem
- start the EC2 instance
- as key choose my-shiny-new-key
- in Security Group allow Port 22 (SSH) and Port 8080 (Jenkins) for your own IP
- (an new security group can also be created after the instance is launched)
-
Install Jenkins sudo apt update && apt upgrade && apt install -y default-jdk
Add Jenkins' repo key to the system: wget -q -O - https://pkg.jenkins.io/debian/jenkins.io.key | sudo apt-key add -
Append the Debian package repo address to the server's sources.list: sudo sh -c 'echo deb http://pkg.jenkins.io/debian-stable binary/ > /etc/apt/sources.list.d/jenkins.list'
Run update again and finally install jenkins: sudo apt update sudo apt install jenkins
Check if Jenkins is running: sudo systemctl status jenkins (service --status-all should also work)
If Jenkins is up and running, it can be accessed on its default port 8080. The fist screen one should see, will look like this:
-
Set Up Jenkins To get the initial admin password, run the following command inside the ssh terminal, which is connected to the ec2 instance running jenkins: sudo cat /var/lib/jenkins/secrets/initialAdminPassword
Install the suggested plugins, create an admin user,set the Jenkins URL and finish.
Install Plugins:
- Blue Ocean
- Pipeline: AWS Steps
After the plugins were successfully installed, restart jenkins
-
Set Up a Pipeline Create a git Repository (like this) Within this repository create a html-File like this: ''' <!doctype html> <title>Static HTML Site</title>
This is the first paragraph in a simple Static HTML site. There is no CSS</ strong> or JavaScript</script>.
''' Create a Jenkinsfile containing the pipeline: ''' pipeline { agent any stages { stage('Build') { steps { sh "echo Hello World" sh ''' echo "Multiline shell steps works too" ls -lah ''' } } } }
'''In Jenkins, select the Blue Ocean Plugin and create a Pipeline. Select GitHub as SCM. In order to access GitHub, Jenkins ask for an access token. Create this token and connect Jenkins and GitHub. Select the desired repository.
After everything is set up, the pipeline overview will look like this: IMG
-
Set Up AWS Credentials in Jenkins: Credentials --> global --> Add credentials After creation, the credentials should be available for the rest of the system
-
Set up a S3 Bucket Create a S3 Bucket. Stick to the default settings but uncheck the "Block all public access" Button.
Enable Static website hosting: After creating the bucket. Go to the configuration panel and select Properties. Enable Static Website Hosting. Choose index.html for the index document.
Add a bucket policy. ''' { "Version": "2012-10-17", "Statement": [ { "Sid": "PublicReadGetObject", "Effect": "Allow", "Principal": "", "Action": "s3:GetObject", "Resource": "arn:aws:s3:::udacity-aws-pipeline-bucket/" } ] }
''' -
Create Pipeline for uploading to S3 Replace the initial Build Stage in the Jenkinsfile with a new Upload-Stage ''' pipeline { agent any stages { stage('Upload to AWS') { steps { withAWS(region: 'us-west-2', credentials: 'aws') { s3Upload(file: 'index.html', bucket: 'udacity-aws-pipeline-bucket', path: 'index.html') } } } }
}''' add, commit and push this change to GitHub. The Jenkins pipeline will run shortly afterwards.
-
Add an additional Stage to the pipeline The additional step will check the html-file befor uploading. Therefore, tidy is installed on the EC2 instance running Jenkins. ''' sudo apt-get install -y tidy '''