In General, to initialize NodeJS AWS-SDK we need to use the access key and the secret to configure it as per one of the methods describe below.

1. Loaded from the shared credentials file (~/.aws/credentials)
2. Loaded through ENV variables
   • AWS_ACCESS_KEY_ID
   • AWS_SECRET_ACCESS_KEY
3. Configure at AWS SDK initialization config

var AWS = require('aws-sdk');
const credentials = {
  accessKeyId: <AWS_ACCESS_KEY_ID>,
  secretAccessKey: <AWS_SECRET_ACCESS_KEY>,
  region: <REGION>
};
AWS.config.update(credentials);

In all of the above cases the AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY need to be exposed to the execution machine, In some cases, it may be a security issue as per the use case. Now How we will get the AWS account permission without having these credentials?

To achieve this we will use the IAM Role assignment to access the services.

Prerequisites

• AWS Account Access (To create IAM Role)
• EC2 Instance (Host the Node App and to use IAM Role)

Solution

1. Create IAM Role

a. Select IAM from AWS Services Menu

b. Select Roles from Access Management Menu and Click on Create Role

c. Select Entity Type as AWS Service and Use Case to EC2 and Click Next

d. Select Appropriate permissions needed, In our case to test S3 select AmazonS3FullAccess and Click Next

e. Give Role Name, Description, and Review Permission and Click Create Role

2. NodeJS AWS-SDK Usage

Creating NodeJS App to use aws-sdk and perform actions on AWS resources. We will use S3 resource to

• i. List buckets
• ii. Create bucket
• iii. List Objects in bucket
• iv. Upload the file into the bucket
• v. Remove file from bucket
• vi. Remove Bucket

For the above requirement, we have created the app with the following directory structure and code snippets.

Directory Structure of NodeJS Application

a. listBucket.js

// Load the AWS SDK for Node.js
var AWS = require('aws-sdk'); 

// Set the region 
AWS.config.update({region: 'ap-southeast-1'}); 

// Create S3 service object 
s3 = new AWS.S3({apiVersion: '2006-03-01'});

// Call S3 to list the buckets 
s3.listBuckets(function(err, data) { 
  if (err) { 
    console.log("Error", err); 
  } else { 
    console.log("Success", data.Buckets);   
  } 
});

b. createBucket.js

// Load the AWS SDK for Node.js
var AWS = require('aws-sdk');
// Set the region
AWS.config.update({region: 'ap-southeast-1'});

// Create S3 service object
s3 = new AWS.S3({apiVersion: '2006-03-01'});

// Create the parameters for calling createBucket
var bucketParams = {
  Bucket : 'shashibadhuk-test-bucket-demo-22'
};

// call S3 to create the bucket
s3.createBucket(bucketParams, function(err, data) {
  if (err) {
    console.log("Bucket Creation Error", err);
  } else {
    console.log(`Bucket ${bucketParams.Bucket} is created`, data.Location);
  }
});

c. listBucket.js

// Load the AWS SDK for Node.js
var AWS = require('aws-sdk');
// Set the region 
AWS.config.update({region: 'ap-southeast-1'});

// Create S3 service object
s3 = new AWS.S3({apiVersion: '2006-03-01'});

// Create the parameters for calling listObjects
var bucketParams = {
  Bucket : 'shashibadhuk-test-bucket-demo-22',
};

// Call S3 to obtain a list of the objects in the bucket
s3.listObjects(bucketParams, function(err, data) {
  if (err) {
    console.log("Error", err);
  } else {
    console.log("Success", data);
  }
});

d. uploadS3.js

// Load the AWS SDK for Node.js
var AWS = require('aws-sdk');
// Set the region 
AWS.config.update({region: 'ap-southeast-1'});

// Create S3 service object
var s3 = new AWS.S3({apiVersion: '2006-03-01'});

// call S3 to retrieve upload file to specified bucket
var uploadParams = {
  Bucket: 'shashibadhuk-test-bucket-demo-22', 
  Key: '', 
  Body: ''
};
var file = 'myCustomFile.txt';

// Configure the file stream and obtain the upload parameters
var fs = require('fs');
var fileStream = fs.createReadStream(file);
fileStream.on('error', function(err) {
  console.log('File Error', err);
});
uploadParams.Body = fileStream;
var path = require('path');
uploadParams.Key = path.basename(file);

// call S3 to retrieve upload file to specified bucket
s3.upload (uploadParams, function (err, data) {
  if (err) {
    console.log(`File ${file} Upload Error`, err);
  } if (data) {
    console.log(`File ${file} Uploaded on Bucket ${uploadParams.Bucket} `, data.Location);
  }
});

e. removeObject.js

// Load the AWS SDK for Node.js
var AWS = require('aws-sdk');
// Set the region
AWS.config.update({region: 'ap-southeast-1'});

// Create S3 service object
s3 = new AWS.S3({apiVersion: '2006-03-01'});

// Create params for S3.deleteBucket
var bucketParams = {
  Bucket: 'shashibadhuk-test-bucket-demo-22',
  Key: 'myCustomFile.txt'
};

s3.deleteObject(bucketParams, function(err, data) {
  if (err) 
    console.log(err, err.stack); // an error occurred
  else    
    console.log(data);           // successful response
});

f. removeBucket.js

// Load the AWS SDK for Node.js
var AWS = require('aws-sdk');
// Set the region
AWS.config.update({region: 'ap-southeast-1'});

// Create S3 service object
s3 = new AWS.S3({apiVersion: '2006-03-01'});

// Create params for S3.deleteBucket
var bucketParams = {
  Bucket : 'shashibadhuk-test-bucket-demo-22'
};

// Call S3 to delete the bucket
s3.deleteBucket(bucketParams, function(err, data) {
  if (err) {
    console.log("Error", err);
  } else {
    console.log("Success", data);
  }
});

Now create myCustomFile.txt with some random text, which will be used by uploadS3 to upload file in S3

3. Verify Code without IAM Role

Now executing the node application to list bucket without having any permission config and IAM Role assignment

4. Attach IAM Role to EC2 Instance

Select EC2 from AWS Service Menu and from instance listing select instance, select Actions > Security > Modify IAM Role

Now select the IAM Role created earlier and click save

5. Verify Code with IAM Role

After the assignment of IAM Role now its time to test the application

6. Verify Bucket on AWS Console

Similarly, we can access other AWS resources by assigning respective IAM Roles, but make sure to follow least privilege as per AWS standard.

Please share this article if seems useful and connect with me on linkedin.

If you find this helpful, then please support me by buying a coffee.