4
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 26 May 2025
4 points (100.0% liked)
Service Clouds: AWS, Azure, GCP, etc.
205 readers
1 users here now
A community for discussions related to all cloud service providers and the tools of the trade.
Related Communities:
General
Tools
Platforms
Infrastructure Orchestration
Programming
founded 2 years ago
MODERATORS
Having yt-dlp save the videos to S3 will just add to your costs - what benefit will it provide to your users to get the file from S3 compared to Youtube?
While 'cloud computing' is managing servers in the cloud like EC2, they're still just servers like you'd run in your lab. To do it the 'cloud way', use the cloud services instead.
My suggestion would be a price checker - create a webpage maybe with S3 or Lightsail where users can enter in a URL for a product, an email address and a scrape recurrence time like 24hours, then have Lambda scrape the page & email the price to the user on that schedule. Use DynamoDB (or a relational DB like Postgresql) to save the results, schedule, etc.
Try not to use EC2 at all if possible. Or instead of EC2, use EKS if scraping with Lambda is too difficult.
The most important thing is getting the security right, from your access to AWS to ensuring your database isn't easily downloaded by just anyone.