Skip to content

Latest commit

 

History

History
49 lines (38 loc) · 2.2 KB

README.md

File metadata and controls

49 lines (38 loc) · 2.2 KB
Raw

Radio-T Dumper

A.K.A. Http copier, because you can use it with different sites, and it will successfully detect file type and download content.

In an endless loop with a break on delay (to avoid creating a heavy load on the target server), the application will wait for a OK 200 response, after which it will copy the response body into the generated file.

Features

  • File type detection (without losing bytes)
  • Waiting for broadcast availability
  • Delay for avoiding creating a heavy load on the target server
  • Automatic generation of human-readable file names
  • Unlimited number of files (Limited by disk space)
  • Unit tests

Configuration

You can use dumper.yml file or environment variables for configuration.

yml env default description
source_url SOURCE_URL Address from where to download information
file_prefix FILE_PREFIX Prefix for files
schedule SCHEDULE Schedule for downloading information in cron format
duration DURATION Duration of the dump
delay DELAY 5s Delay between request in case of interruption of the stream
file_date_format FILE_DATE_FORMAT 02_01_2006 Date format for files
output_directory OUTPUT_DIRECTORY . Directory where to save files
log_level LOG_LEVEL info Log level

Run with docker compose

Before starting the application, you can change output directory volume in docker-compose.yml file from ./records to your desired directory. In container all files will be in the /tmp/output directory.

To start the application, run:

docker-compose up -d