Bulk insert/update

[AaronVasquez]

Would be nice to have a bulk insert or update function.

[stanislas-m]

Related issue from the previous repo: https://github.com/markbates/pop/issues/185

Here some points to work on it:

• https://godoc.org/github.com/lib/pq#hdr-Bulk_imports
• For others DBs, we can improve this case reusing prepared statements.

[mclark4386]

The linked doc looks like it will work for the CockroachDB implementation as well. (https://godoc.org/github.com/lib/pq#hdr-Bulk_imports)

(CockroachDB docs for reference: https://www.cockroachlabs.com/docs/stable/insert.html#insert-multiple-rows-into-an-existing-table )

[paganotoni]

This would be awesome, when i think on this one i'm thinking in something like:

err := tx.BatchSave(&records)
...

I would love to discuss if this sounds good, i don't usually do batch insert but wanted to add those 5 cents to the discussion

[derkan]

Hi, at gobenchorm, I used following code for benchmarking BulkInsert:

                ms = make([]PModel, 0, 100)
		for i := 0; i < 100; i++ {
			ms = append(ms, *NewPModel())
		}
		if err := popdb.Create(&ms); err != nil {
			fmt.Println(err)
			b.FailNow()
		}

Bu it was so time consuming that I had to disable benchmarking for BulkInsert. How can I make it better?

[markbates]

@derkan great question! I think it's time we, as a community, start looking at the performance of Pop and trying to improve it. Here's how you can help. Start by opening an issue saying Pop needs benchmarking and profiling so it's performance can be improved.

Then, encourage someone out there, or if you want to do it even better, start adding some benchmarking and profiling results to a new ticket that says "this method needs to be improved, here are the metrics".

Then, people can come along, grab a ticket, work on that one method, and before we know it Pop is humming along.