Comments on: Large loops = out of memory? http://www.erichynds.com/coldfusion/large-loops-out-of-memory/ Web Developer's Ramblings on JavaScript, jQuery, ColdFusion, MySQL, and other technologies. Wed, 04 Jan 2012 16:01:00 +0000 hourly 1 http://wordpress.org/?v=3.2.1 By: Danny Armstrong http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-3128 Danny Armstrong Fri, 23 Apr 2010 21:42:25 +0000 http://www.erichynds.com/blog/?p=24#comment-3128 Do you have memory profiling turned on on your dev machine? This can have a huge memory overhead. I had an application that would balloon like crazy on dev (linux) and not on the server (windows). After turning off the monitoring stuff the performance equalled out. Do you have memory profiling turned on on your dev machine? This can have a huge memory overhead. I had an application that would balloon like crazy on dev (linux) and not on the server (windows). After turning off the monitoring stuff the performance equalled out.

]]> By: Danny Armstrong http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-3849 Danny Armstrong Fri, 23 Apr 2010 21:42:00 +0000 http://www.erichynds.com/blog/?p=24#comment-3849 Do you have memory profiling turned on on your dev machine? This can have a huge memory overhead. I had an application that would balloon like crazy on dev (linux) and not on the server (windows). After turning off the monitoring stuff the performance equalled out. Do you have memory profiling turned on on your dev machine? This can have a huge memory overhead. I had an application that would balloon like crazy on dev (linux) and not on the server (windows). After turning off the monitoring stuff the performance equalled out.

]]> By: Eric Hynds http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-1623 Eric Hynds Tue, 15 Dec 2009 18:14:53 +0000 http://www.erichynds.com/blog/?p=24#comment-1623 It's turning out to be a Linux thing. The memory leak(s) do not occur when running the same code on a Windows Server 2008 box. It’s turning out to be a Linux thing. The memory leak(s) do not occur when running the same code on a Windows Server 2008 box.

]]> By: Anonymous http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-3848 Anonymous Tue, 15 Dec 2009 18:14:00 +0000 http://www.erichynds.com/blog/?p=24#comment-3848 It's turning out to be a Linux thing. The memory leak(s) do not occur when running the same code on a Windows Server 2008 box. It’s turning out to be a Linux thing. The memory leak(s) do not occur when running the same code on a Windows Server 2008 box.

]]> By: Eric Hynds http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-1423 Eric Hynds Wed, 18 Nov 2009 13:19:00 +0000 http://www.erichynds.com/blog/?p=24#comment-1423 Wow, thanks for the good info guys. Next time I'm working on the project I'll play around with some of these suggestions and report back. Wow, thanks for the good info guys. Next time I’m working on the project I’ll play around with some of these suggestions and report back.

]]> By: Anonymous http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-3847 Anonymous Wed, 18 Nov 2009 13:19:00 +0000 http://www.erichynds.com/blog/?p=24#comment-3847 Wow, thanks for the good info guys. Next time I'm working on the project I'll play around with some of these suggestions and report back. Wow, thanks for the good info guys. Next time I’m working on the project I’ll play around with some of these suggestions and report back.

]]> By: Brian Kotek http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-1366 Brian Kotek Wed, 11 Nov 2009 20:36:53 +0000 http://www.erichynds.com/blog/?p=24#comment-1366 Java Strings are immutable, so every time you concatenate a String or update a String, you're actually creating an entirely new instance of the String. This is why memory consumption can skyrocket when reading or writing large text files. There are a number of Java classes that will do this for you, such as StringBuffer, BufferedReader, StringWriter, etc. A Google search on these will point you in the right direction. Java Strings are immutable, so every time you concatenate a String or update a String, you’re actually creating an entirely new instance of the String. This is why memory consumption can skyrocket when reading or writing large text files. There are a number of Java classes that will do this for you, such as StringBuffer, BufferedReader, StringWriter, etc. A Google search on these will point you in the right direction.

]]> By: Brian Kotek http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-3846 Brian Kotek Wed, 11 Nov 2009 20:36:00 +0000 http://www.erichynds.com/blog/?p=24#comment-3846 Java Strings are immutable, so every time you concatenate a String or update a String, you're actually creating an entirely new instance of the String. This is why memory consumption can skyrocket when reading or writing large text files. There are a number of Java classes that will do this for you, such as StringBuffer, BufferedReader, StringWriter, etc. A Google search on these will point you in the right direction. Java Strings are immutable, so every time you concatenate a String or update a String, you’re actually creating an entirely new instance of the String. This is why memory consumption can skyrocket when reading or writing large text files. There are a number of Java classes that will do this for you, such as StringBuffer, BufferedReader, StringWriter, etc. A Google search on these will point you in the right direction.

]]> By: Qasim Rasheed http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-1365 Qasim Rasheed Wed, 11 Nov 2009 19:28:01 +0000 http://www.erichynds.com/blog/?p=24#comment-1365 I recently refactored a process similar to what you have described. Here are few things that I did 1. Used BufferedReader instead of cffile action="read". We are still on CF7 2. Simplified queries by using Oracle's merge (aka upsert) operation. A single merge statement is smart enough to do an insert or update based on condition provided. 3. Instead of running cfquery on each loop iteration, I started using JDBC PreparedStatement as a Batch. after these changes were made, a routine that was consistently timing out, could be run in 15-20 minutes. Thanks I recently refactored a process similar to what you have described. Here are few things that I did

1. Used BufferedReader instead of cffile action=”read”. We are still on CF7
2. Simplified queries by using Oracle’s merge (aka upsert) operation. A single merge statement is smart enough to do an insert or update based on condition provided.
3. Instead of running cfquery on each loop iteration, I started using JDBC PreparedStatement as a Batch.

after these changes were made, a routine that was consistently timing out, could be run in 15-20 minutes.

Thanks

]]> By: Qasim Rasheed http://www.erichynds.com/coldfusion/large-loops-out-of-memory/#comment-3845 Qasim Rasheed Wed, 11 Nov 2009 19:28:00 +0000 http://www.erichynds.com/blog/?p=24#comment-3845 I recently refactored a process similar to what you have described. Here are few things that I did 1. Used BufferedReader instead of cffile action="read". We are still on CF7 2. Simplified queries by using Oracle's merge (aka upsert) operation. A single merge statement is smart enough to do an insert or update based on condition provided. 3. Instead of running cfquery on each loop iteration, I started using JDBC PreparedStatement as a Batch. after these changes were made, a routine that was consistently timing out, could be run in 15-20 minutes. Thanks I recently refactored a process similar to what you have described. Here are few things that I did

1. Used BufferedReader instead of cffile action=”read”. We are still on CF7
2. Simplified queries by using Oracle’s merge (aka upsert) operation. A single merge statement is smart enough to do an insert or update based on condition provided.
3. Instead of running cfquery on each loop iteration, I started using JDBC PreparedStatement as a Batch.

after these changes were made, a routine that was consistently timing out, could be run in 15-20 minutes.

Thanks

]]>