Repository for RDBMS project 1.
Current data statistics:
- Number of station records (Including duplicates): 7121247
- Number of observations (Including Duplicates ): 671319
Tentative values
Direct SQL:
- Insertion to the station table: 267.97901082 (~ 4 minutes) sec for 40,680 records 0.006 sec/record
- Insertion to the observation table: 236.890237093 (3.94817 minutes) for 34,074 records 0.006 sec/record
Batch:
- Insert into Observation table using
cursor.copy_from()
: 0.679203987122 secs for 34,074 records i.e, 0.0199332 ms/record