Where does Snowpipe ingest data from? If it’s FTP or cloud storage using an API, how do you pull the data?
💡 Model Answer
Snowpipe can ingest from internal stages (Snowflake‑managed) or external stages that point to cloud storage buckets (S3, Azure Blob, GCS). For FTP, you typically write a script or use a third‑party tool to copy files from the FTP server to an external stage, then trigger Snowpipe via the REST API or a notification service. The pipeline involves: 1) creating an external stage with the storage location and credentials; 2) setting up a pipe with a COPY INTO statement; 3) configuring a notification mechanism (e.g., S3 event, Azure Event Grid, or a scheduled API call) to inform Snowpipe of new files; 4) Snowpipe automatically loads the files into the target table. This approach ensures near‑real‑time ingestion while keeping the data transfer logic separate from Snowflake.
This answer was generated by AI for study purposes. Use it as a starting point — personalize it with your own experience.
🎤 Get questions like this answered in real-time
Assisting AI listens to your interview, captures questions live, and gives you instant AI-powered answers — invisible to screen sharing.
Get Assisting AI — Starts at ₹500