Bulk import TXT files into Redshift tables

by

Want to bulk import TXT files into Redshift tables at one time?

Try Withdata FileToDB, a desktop TXT to Redshift converter for Windows, MacOS, and Linux, Convert TXT to Redshift, Easy and Fast.

  • Can run in GUI mode, Step by Step, just a few mouse clicks.
  • Can run in Command line, for Scheduled Tasks and Streams.
  • Convert locally and privately, avoid uploading large or private TXT files to online services.
  • Support Windows, Linux, and macOS.

Download Withdata FileToDB Download FileToDB

Bulk import TXT files into Redshift tables

Login to Redshift -> Choose TXT files -> Set Redshift tables -> Import TXT files to Redshift tables

Choose Redshift and logon.

bulk import TXT files into Redshift tables - Choose Redshift and logon

Click “Wizard – N Files To N Tables” at task dialog.

bulk import TXT files into Redshift tables - task window

Select the “TXT” file type.

bulk load TXT files into Redshift tables - select file type

then show the wizard.

1. Select a folder that constains TXT files.

Support large ( > 4GB ) TXT files.

bulk import TXT files into Redshift tables - select a folder

2. Config first TXT file importing options.

bulk import TXT files into Redshift tables - config first file

3. Set “Import Type”.

bulk import TXT files into Redshift tables - set tables

4. Map Redshift tables to TXT files.

bulk import TXT files into Redshift tables - map

5. Summary. Set “Convert Rows” and “Skip Rows” if need.

bulk import TXT files into Redshift tables - preview

6. Import TXT files to Redshift tables, 1 file to 1 table, one by one.

bulk import TXT files into Redshift tables - import data

View imported data in Redshift table

bulk import TXT files into Redshift tables - view data

Bulk import TXT files into Redshift tables in command line

Save “bulk TXT files to Redshift tables” session, then you can:

Set scheduled tasks for bulk importing TXT files into Redshift tables

You can schedule and automate this converting task by:

  1. Save session and create .bat (Windows) or .sh (Linux/macOS) file for “TXT to Redshift” conversion.
  2. Set scheduled task for “TXT to Redshift” conversion.

FAQ


More about Withdata FileToDB – TXT to Redshift converter

See also:

TXT → Redshift reference

Type mapping

Value kindin TXTin Redshift
Int1234, or right-aligned in a fixed-width columninteger
Bigint9007199254740993bigint
Decimal1234.56numeric(p,s)
Float1.234e+10double precision
Textwritten as-is; padding depends on the chosen layoutvarchar(n)
Long textwritten as-isvarchar(max)
Datewhatever the writer chosedate
Datetimewhatever the writer chosetimestamp
Binarynot representable(none)
BooleanY / N, or 1 / 0, or TRUE / FALSEboolean
JSONwritten as-issuper

Dialect differences

TXT is a file format and Redshift is a database server, so the target has to be told the types the file never carried - the rows below are where the two sides diverge.

Propertyin TXTin Redshift
port—5439
identifiersNone by convention"double quotes"
row limit—LIMIT n
datesWhatever the writer produced; no convention is guaranteedtimestamp, date
long text—VARCHAR(MAX)
binaryNot supported—
separatorWhatever was chosen - often fixed column widths—
encodingNo declaration - UTF-8 works only with a BOM—
typingNone - every field is text—
shapeFree form; a parser has to be told the layoutTables of rows and columns
ceilingNo formal limit—

Command line

SideCommand
RedshiftUNLOAD to S3
Redshift (load)COPY from S3

No counterpart

  • TXT values of kind Binary have nowhere to go in Redshift.

Convert your data online, free

Free in-browser converters for CSV, Excel, JSON, XML and SQL: Withdata Online Data Conversion. Large files, batch conversion or scheduling? See the offline desktop apps, or browse all data conversion tools.