I have couple of use cases and just wondering if AWS glue can solve it or not. First use case is we receive data from upstream system via SQS and save them to DocumentDB on AWS. Our requirement is to poll records received for that specific day from documentdb with certain status, enrich data with more information by pulling from another data source, generate file and then upload to s3 so that another team can consume it. Second requirement is different files will be uploaded to s3 bucket per day and we need to read the file, parse it and then update data in 2 different data sources. Can AWS Glue help solve both the requirements? Or is there a easy way to do it. Appreciate any help or suggestions.
Does AWS Glue have ability to poll document db records and write to a file in bucket
48 views Asked by Mr9 At
0
There are 0 answers
Related Questions in AMAZON-WEB-SERVICES
- S3 integration testing
- How to get content of BLOCK types LAYOUT_TITLE, LAYOUT_SECTION_HEADER and LAYOUT_xx in Textract
- Error **net::ERR_CONNECTION_RESET** error while uploading files to AWS S3 using multipart upload and Pre-Signed URL
- Failed to connect to your instance after deploying mern app on aws ec2 instance when i try to access frontend
- AWS - Tab Schema Conversion don't show up after creating a Migration Project
- Unable to run Bash Script using AWS Custom Lambda Runtime
- Using Amazon managed Prometheus to get EC2 metrics data in Grafana
- AWS Dns record A not navigate to elb
- Connection timed out error with smtp.gmail.com
- AWS Cognito Multi-tenant Integration | Ok to use Client’s Idp?
- Elasticbeanstalk FastAPI application is intermittently not responding to https requests
- Call an External API from AWS Lambda
- Why my mail service api spring isnt working?
- export 'AWSIoTProvider' (imported as 'AWSIoTProvider') was not found in '@aws-amplify/pubsub'
- How to take first x seconds of Audio from a wav file read from AWS S3 as binary stream using Python?
Related Questions in AMAZON-S3
- Mocking AmazonS3 listObjects function in scala
- S3 integration testing
- Error **net::ERR_CONNECTION_RESET** error while uploading files to AWS S3 using multipart upload and Pre-Signed URL
- Golang lambda upload image into s3 static website
- How to take first x seconds of Audio from a wav file read from AWS S3 as binary stream using Python?
- AWS Lambda Trigger For Same S3 File Name In Quick Succession
- Is there a way to upload a file in digital ocean object storage using php curl
- How to setup AWS credentials for next.js apps?
- S3 pre-signed url not working on whatsapp cloud Api
- How to set custom Origin Name in AWS CDK for CloudFront
- Property 'location' does not exist on type 'File'
- Resource handler returned message: "Unable to validate the following destination configurations
- Webmin CentOS7 AWS backup errors - perl(S3::AWSAuthConnection) can't be installed
- How to access variable to pass through url_for() as src in Flask App
- I cant figure out how to pull scripts from s3 to my aws workspace
Related Questions in AWS-GLUE
- AWS GLUE child node execution order of same level
- Is there a way to import Redshift Connection in PySpark AWS Glue Job?
- Retrieving a list of all failed Glue jobs via CLI
- How do I change the data type in a Glue Crawler?
- Loading around 50gb of parquet data to Redshift taking indefinite time to load
- Glue Notebook not starting: Failed to start notebook
- old aws-glue libraries in the Glue streaming ETL job 4.0?
- Add File name column to Dynamic Frame
- How to test Glue jobs and Athena queries locally on dummy data?
- AWS Glue throws AWSBadRequestException when loading DynamicFrame from s3 with local Glue docker
- AWS Glue Insert and update into oracle table
- SQL query to extract incremental data from a table in SQL Server
- redshift spectrum type conversion from String to Varchar
- Apply transformation on nested json column in dataframe
- Access Denied while creating crawler
Related Questions in AWS-DOCUMENTDB
- Using the $pull operator to remove an object via a nested field from an array in DocumentDB?
- Upload photos and video in AWS documentdb
- Integrating document DB with java outside VPC
- Amazon DocumentDB query with multiple distinct field not working
- Best way to add / remove a field from all queries
- Glue connection with DocumentDB with ssl enabled get timeout
- Type-checking in mongoDB filter with sub-objects
- Is it feasible to have a cluster of two MongoDB On Premise VMs and a DocumentDB on AWS?
- AWS Document DB no coonect with MongoClient
- Field 'writeConcern' is currently not supported using Mongock with AWS Document DB
- Unable to do mongodump or mongoexport from AWS DocumentDB instance
- Error: Parameters cannot be modified at the same time in AWS Document DB Elastic Cluster (CDK/ Cloudformation)
- How to rotate AWS DocumentDB password through secret manager cron expression via CDK?
- How to pass AWS Secret to Elastic Document DB Cluster using CDK/ Terraform/ Cloudformation
- How to use Amazon documentdb with langchain?
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)