Can AWS Credentials Be Used to Authenticate SageMaker for Voyage Embeddings?

Below is some clarification regarding AWS credentials and SageMaker authentication:

Using AWS Credentials with SageMaker

AWS credentials (access key ID and secret access key) are used for signing requests with AWS Signature Version 4 (SigV4), which is the standard authentication mechanism for most AWS services—including SageMaker. This means that if your process has valid AWS credentials, you are set to authenticate calls to SageMaker endpoints.

Difference from Other Services (e.g., Bedrock)

Some services (like Bedrock embeddings) may use a more streamlined API key approach. In contrast, SageMaker requires that requests be signed with AWS SigV4 (either directly or via an AWS SDK) which incorporates IAM roles and policies. This is why, in your Voyage community node, you might be noticing a different type of authentication compared to what you might expect with a plain API key.

Implementing Authentication in Your Node

To improve your Voyage node to support AWS credentials for SageMaker, you'll need to ensure that your HTTP requests to SageMaker endpoints are properly signed. If you're using the AWS SDK for JavaScript (v2 or v3), this is handled automatically when you configure your credentials. For example, using the AWS SDK v3:

JAVASCRIPTCopied
import { SageMakerRuntimeClient, InvokeEndpointCommand } from "@aws-sdk/client-sagemaker-runtime";

// Initialize your client with AWS credentials and region
const client = new SageMakerRuntimeClient({
  region: "us-west-2",
  credentials: {
    accessKeyId: "YOUR_ACCESS_KEY_ID",
    secretAccessKey: "YOUR_SECRET_ACCESS_KEY",
  },
});

// Create a command to call your SageMaker endpoint
const command = new InvokeEndpointCommand({
  EndpointName: "your-endpoint-name",
  Body: JSON.stringify({ /* your payload here */ }),
  ContentType: "application/json",
});

async function invokeEndpoint() {
  try {
    const response = await client.send(command);
    console.log("Response:", response);
  } catch (error) {
    console.error("Error invoking endpoint:", error);
  }
}

invokeEndpoint();

Summary

• Yes, AWS credentials do allow you to use SageMaker.
• SageMaker uses AWS SigV4 for request authentication, which is different from plain API key authentication methods.
• When integrating with SageMaker, ensure your node is signing requests appropriately (preferably using one of the AWS SDKs).

This approach should let your Voyage community node leverage AWS credentials for accessing SageMaker endpoints to use your desired Amazon embedding.