It is difficult to add a table with many records to another without creating duplicates

Question

At first, I may seem laconic, but I hope it will be easier for all of you to understand what I am doing in the first place. I have an unusual, but enjoyable activity, collecting as many types of wood as possible from around the world (up to 2900 people). Well, this is a real world.

Meanwhile, I spent more than 8 years collecting more than 5.8 million textual data for all the forests of the world. It became so big that learning some basic PHP and MySQL was most desirable, so I could build a new database for all of this research. I'm still slow but come across. The initial premise was to find evidence of as many forest species in the world as possible. The more names defined, the more successful the project.

I called the TAXA project for ease of conversation (short for taxonomy). You are most welcome to take a look at what I have at           www.prowebcanada.com/taxa . It is dynamically controlled at 95%. So far I am reporting about 6,500 names of botanical forests, and, as mentioned above, the more I can report, the more successful the project will be.

I have a file of all forests in the second largest wood collection in the world, the Tervuren Tree Collection in the Netherlands with over 11,300 tree names even after clearing all duplicates. This is almost twice as much as I am reporting now. porting all new wooden names from Tervuren to the “species” table, where I store the reported data, will be the main desired achievement in the project.

At some point, I was able to add all the Tervuren entries to the view table, but 3,000 duplicates were also generated. They were not in the Tervuren file, but represent the same tree names common to both files. It is believed that to be forest, common to both, which when combined will create new duplicates.

At some point and with the help of others from another forum, I could very well finally receive the correct SQL statement. However, when I started it, the system said (semi-funny at first) ----- that he was gone! Looking at the Web, what could have done is one of the reasons that the MySQL timeout expires and probably because of the large size of the files that I run. I run this on a rented account on Godaddy, so I cannot go about trying to configure any configuration file.

tervuren.sql tervuren_target.sql species.sql species_master.sql tp , , . species_master species.sql, , .

18 , 5 Tervuren ( ). , . - "_" . , , - . - , .

, ( ) . , SELECT DISTINCT , , (, ), "DISTINCT" . , "" , , , . , NEW tervuren_target.species_name .species_name.

, SQL- - -. ? , , , PHP SQL? ..... Tervuren (, ....) "

, , . , , , , .

, 64- Windows 7, , , . Ethernet, .

, , , "" . (), ( )!

, , . ? , CC'd billmudry rogers.com:-)

,

, , ( ).

Answer 1

, . , 8 . , , .

, :

CREATE TABLE table2 LIKE table1

. , 1 2:

SELECT * FROM table2
JOIN table1
ON table2.species_name = table1.species_name

, 2:

DELETE FROM table2
USING table2
JOIN table1
ON table2.species_name = table1.species_name

, . , , :

SELECT COUNT(*) FROM table2

, , 1:

INSERT INTO table1
SELECT * FROM table2

2, .

Answer 2

UNIQUE 5 , . MySQL INSERT IGNORE .

ALTER TABLE Taxa 
    ADD UNIQUE KEY (Field3,Field7,Field8,etc.);

INSERT IGNORE INTO Taxa...;