I have a rails app that has a google cloud bucket I am accessing from a rake task. The rake task works fine locally but when I run the task in production on heroku it fails with this error

/app/vendor/ruby-3.1.2/lib/ruby/3.1.0/socket.rb:1214:in __connect_nonblock’: Failed to open TCP connection to 169.254.169.254:80 (Operation already in progress – connect(2) for 169.254.169.254:80) (Errno::EALREADY)`

I’ve already confirmed that the service account key is properly being loaded. I can even see that requests are hitting the bucket in the cloud console dashboard for the bucket, but for some reason I’m getting this error and I’m not sure what to make of it.

Chatgpt seems to think it has something to do with the google metadata server? Thanks in advance for any tips / help.

For reference, here is the service code

require "base64"
require "google/cloud/storage"

class GoogleCloudBucketService
  def initialize(bucket_name)
    @bucket_name = bucket_name
    decoded_json_key = Base64.decode64(ENV['GCP_SERVICE_ACCOUNT_JSON_KEY_BASE64'])
    json_key_hash = JSON.parse(decoded_json_key)
    @storage = Google::Cloud::Storage.new(
      credentials: json_key_hash
    )
  end

  def get_file(file_name)
    bucket = @storage.bucket(@bucket_name)

    unless bucket
      raise "Bucket #{@bucket_name} not found"
    end

    file = bucket.file(file_name)

    unless file
      raise "File #{file_name} not found in bucket #{@bucket_name}"
    end

    file.download.read
  rescue Google::Cloud::Error => e
    # Handle Google Cloud specific errors
    raise "An error occurred while accessing Google Cloud Storage: #{e.message}"
  rescue StandardError => e
    # Handle other errors
    raise "An error occurred: #{e.message}"
  end

  def write_file(file_name, csv_content)
    bucket = @storage.bucket(@bucket_name)

    unless bucket
      raise "Bucket #{@bucket_name} not found"
    end

    file = bucket.create_file(StringIO.new(csv_content), file_name)

    unless file
      raise "Failed to create file #{file_name} in bucket #{@bucket_name}"
    end

    file
  rescue Google::Cloud::Error => e
    # Handle Google Cloud specific errors
    raise "An error occurred while accessing Google Cloud Storage: #{e.message}"
  rescue StandardError => e
    # Handle other errors
    raise "An error occurred: #{e.message}"
  end
end