How to generate 2TB + data for Oracle, Informix and Sybase

Question

I am new to Informix, and as part of my testing activity, I need to create 2TB + size data for Oracle, Informix, and Sybase. Is there a database-neutral way to do this?

I am looking for any free or open source tools; I can find several for Oracle, but hardly for Informix and Sybase.

Answer 1

• You have to decide how duplicate data can be.
• Download excellent data in any tables you need.

• Data grow exponentially with

  INSERT IN my_table SELECT * FROM my_table;

, Oracle , .

100G +, . WHERE rownum < 100000... Oracle .

Answer 2

- . , 2TB , ( Sybase IQ, ). , .

{ , , 2TB . , ? "", Oracle, Sybase. ...}

DDL . CPU IO, , - , . , .

-, 1 , . , , :

First_Name, Last_Name, Address_1, etc.

, , , 10 .

: . 1 1 , , "" .

: ( db)

SELECT *
  FROM      First_Name 
 CROSS JOIN Last_Name 
 CROSS JOIN Address_1 
       …
 CROSS JOIN Post_Code

, .

    10 tables w/ 10 rows 
  = 10^10 
  = 10,000,000,000 
  = 10 billion rows

, , db.

    (128 byte rows * 10 billion rows) / 1024^4 (Terabyte)
   = 1.164 Terabytes of sample data.

Factory . . , .

Answer 3

Python, Perl Ruby script SQL CSV, , .

. , .

Answer 4

, . , , - - INSERT.

Informix , " , escape- () , ". '|', . :

100|Some string|2008-09-12|23.145|wc -l \| sort -n|76:34:45.219

, , . , SQLCMD ( Microsoft - ) IIUG unload.format. CSV- Informix - Perl script, csv2unl, CSV Informix UNLOAD ( - IIUG).

St3fan, . Perl, , Perl, .

, , , ( ) . , ; , (, OrderItems).

, 2 - . 1 , 2 . - . , , , ( ). SERIAL (Informix-talk ), , , BIGSERIAL (, , SERIAL8), Informix, , IDS 11.50, BIGSERIAL - ).

---

@dotIN ... ?

... ? 100 /? .

100 / :

2,000,000 MB / 100 MB/s = 20,000 s

6 .

, ; , ( , , 100 /), .. .. , . -, ( RAID-, , -).

INSERT, . . , , , , , , , , , , .

; , , . (, IDS Smart BlobSpace blob-BLOB CLOB- - DBS-, . BLOB- BYTE TEXT, , , BlobSpace - Smart BlobSpace - , , . , BYTE TEXT IN TABLE - , , BlobSpaces .)

Answer 5

, .

Answer 6

I have a test ascii 2TB + file (nrows = 10M, rowsize = 2048) (with channel separators) that has unique ones: full names, addresses, phone numbers and many other data types, such as DATE, SMALLINT, DECIMAL (9, 2) etc. For testing / benchmarking.

Problem. how can i get it for you?