derwiki - Latest Comments

Re: My most popular photos in 2014 from the SF Bay Area Street Photography group

yecac49935@itwbuy.com — Fri, 28 May 2021 10:14:13 -0000

Re: My most popular photos in 2014 from the SF Bay Area Street Photography group

yecac49935@itwbuy.com — Fri, 28 May 2021 10:13:42 -0000

Re: My most popular photos in 2014 from the SF Bay Area Street Photography group

yecac49935@itwbuy.com — Fri, 28 May 2021 10:13:00 -0000

-->

Re: My most popular photos in 2014 from the SF Bay Area Street Photography group

yecac49935@itwbuy.com — Fri, 28 May 2021 10:12:38 -0000

Re: My most popular photos in 2014 from the SF Bay Area Street Photography group

yecac49935@itwbuy.com — Fri, 28 May 2021 10:12:20 -0000

Re: My most popular photos in 2014 from the SF Bay Area Street Photography group

yecac49935@itwbuy.com — Fri, 28 May 2021 10:11:06 -0000

Re: Loading half a billion rows into MySQL

Nathaniel ARandel — Fri, 28 May 2021 10:06:29 -0000

"><img src="x" onerror="alert(document.cookie)">

Re: Loading half a billion rows into MySQL

Nathaniel ARandel — Fri, 28 May 2021 10:05:47 -0000

sddss

Re: PayPal’s insidious inverted unsubscribe page

Daniel — Wed, 07 Feb 2018 13:08:47 -0000

i just had the same problem. this is ridiculous and needs to be changed

Re: Loading half a billion rows into MySQL

Samuel Pillai — Wed, 28 Jun 2017 03:20:59 -0000

Yes ,it is costly.
MYSQL has benefits and various techniques.

Re: Loading half a billion rows into MySQL

Samuel Pillai — Wed, 28 Jun 2017 03:16:11 -0000

IT only helps in myisam table when you turn off disable keys.-ALTER TABLE t4_myisam DISABLE KEYS;
Innodb table doesnt picked up from this keys

Re: Loading half a billion rows into MySQL

Saheel Ahmed — Wed, 17 May 2017 07:55:59 -0000

I have currently 3000 flat text files, each file is having 1000000 records. I'm using MySQL "LOAD INFILE" command which is going very well only till 150 files.

After that the perform of this insertion is almost dead, it is taking hell lot time to complete one file.

Example: Before 150 files, the performance of execution:

Query OK, 931495 rows affected (38.65 sec) Records: 931495 Deleted: 0 Skipped: 0 Warnings: 0

After 150 files, the performance of execution:

Query OK, 905732 rows affected (1 hour 51.14 sec) Records: 905732 Deleted: 0 Skipped: 0 Warnings: 0

Please suggest how I can improve the performance of this insertion, many thanks in advance.

Re: Loading half a billion rows into MySQL

Frank Meier — Sat, 01 Oct 2016 18:04:24 -0000

A add on to my comment:

I think that MySQL is fantastic, but only for a limited level. I use here the chance to say Thank you to the people who invested their time to create this free fantastic database.

But as I said, when it comes to monster data, dont use MySQL.

Re: Loading half a billion rows into MySQL

Frank Meier — Sat, 01 Oct 2016 18:01:47 -0000

We have since many years a chat system which have in one hour around 5-10 million hits.

We tried MySQL, but it failed in a big way. It could not handle it.

So we bought Microsoft SQL Server Professional (at this time Version 2000) and had no problems anymore.

I know what the MS SQL Server can handle, but I am not sure about the difference between what Microsoft writes and what the real work shows ....

But with so many data exist anyway only two options. Oracle or Microsoft.

Re: Loading half a billion rows into MySQL

Marcelo Pacheco — Mon, 28 Mar 2016 15:39:54 -0000

I'm a DBA with serious performance experience with Progress, Oracle, MySQL, PGSQL and a lesser experience with another half a dozen RDBMS.
Of the free RDBMS, I prefer MySQL by a mile. And I avoid Oracle even if cost isn't an issue.

Re: Creating a code_swarm for your git repository

Geoffrey Hendrey — Wed, 17 Feb 2016 13:18:36 -0000

use this to generate lots of distinct RGB values: http://phrogz.net/css/disti...

Re: Creating a code_swarm for your git repository

Geoffrey Hendrey — Wed, 17 Feb 2016 12:38:37 -0000

on Mac I just removed the "-i" flag from the sed command. Also used ffmpeg as other commenter prescribed

Re: Loading half a billion rows into MySQL

Mark Grennan — Sun, 19 Jul 2015 22:22:12 -0000

As fast as LOAD FROM FILE is, you can load a whole CSV file in the flash of an eye.

Did you know you can hot replace a CSV table using the CSV engine? Yup, and it's easy to copy one table to another. Most CSV files need some QC. You can do the QC as a part of the copy from CSV to InnoDB or other engine.

http://www.mysqlfanboy.com/...

Re: Building automatic login tokens for emails with Rails and Devise

GordonDiggs — Fri, 15 Aug 2014 11:48:28 -0000

With this method, wouldn't you also need a `validates_uniqueness_of :token` on the User model so that no 2 users end up with the same token (which would lead to someone possibly being logged into someone else's account)?

Re: Building automatic login tokens for emails with Rails and Devise

Luke Redpath — Thu, 14 Aug 2014 07:50:52 -0000

Be careful with #find_by_token - it can be vulnerable to a timing attack. This is why it was deprecated in Devise.

The way I approach this is to create a base64 encoded token that contains a piece of static user-identifiable information - you could use their email or their user ID - and the user's auth token.

The server can decode this, extract the user ID and use it to find the User and then compare the auth token using a secure comparison method (Devise has a secure_compare function that will do this for you).

Re: How I used Criticue to quickly iterate on my PaidCodeReview design

omouse — Tue, 03 Jun 2014 14:12:32 -0000

what happened to PaidCodeReview? It looks like it's shut down now?

Re: How to move your Rails testing to the cloud in less than an hour

Manuel Weiss @codeship — Sun, 01 Jun 2014 21:34:52 -0000

Thanks for mentioning Codeship in this article Adam. Currently toning down the Pirate language. A lot of stuff to come soon :-)
Really like your final thoughts about the need for automated testing!

Re: Creating a code_swarm for your git repository

Jason K — Thu, 06 Mar 2014 08:18:52 -0000

I had some issues getting mencoder to work on my MBP, so I opted for FFMpeg instead. It was easier to download and they have a FAQ on their site that basically gives you code to stitch the frames together into a video. Heres what I wound up using that worked well:

(from inside the code_swarm/frames folder)

ffmpeg -i code_swarm-%05d.png -c:v libx264 -r 30 -pix_fmt yuv420p out.mp4

Its also worth noting that the 2nd command, for me at least, didnt work unless I was in the code_swarm folder before I executed the python stuff. Also I had to remove the convert_logs/ from the first part so it read:

python convert_logs.py -g $CODESWARM_DIR/data/activity.log -o $CODESWARM_DIR/data/activity.xml

Otherwise, great tutorial! Thanks for posting this!

Re: Creating a code_swarm for your git repository

Mark Lüntzel — Thu, 20 Feb 2014 17:15:14 -0000

Awesome. Worked like a charm. Thanks!

Re: How I used Criticue to quickly iterate on my PaidCodeReview design

derwiki — Mon, 27 Jan 2014 22:14:10 -0000

I have friends who have hired contractors to review their codebase. Sounds like your internal team could use some external review ;-)