| Summary | VFS Memory Usage |
| Queue | Horde Framework Packages |
| Queue Version | Git master |
| Type | Bug |
| State | Not A Bug |
| Priority | 2. Medium |
| Owners | |
| Requester | slusarz (at) horde (dot) org |
| Created | 11/17/2011 (5143 days ago) |
| Due | |
| Updated | 02/02/2017 (3239 days ago) |
| Assigned | |
| Resolved | 11/17/2011 (5143 days ago) |
| Github Issue Link | |
| Github Pull Request | |
| Milestone | |
| Patch | No |
commit 9198c3c8fac5e8b4213a3e5853281ce2439a5c08
Author: Michael J Rubinsky <mrubinsk@horde.org>
Date: Thu Feb 2 12:11:17 2017 -0500
Allow Horde_Vfs::writeData to accept a stream as input.
For every driver except Mongo, the stream is maintained. Mongo
must read it into a string since there is no way to stream the
bytes to the backend.
Related to
Bug: 10775.framework/Vfs/lib/Horde/Vfs/Base.php | 31 ++++++++++++++++++++++++++-----
framework/Vfs/lib/Horde/Vfs/File.php | 15 ++++++++++-----
framework/Vfs/lib/Horde/Vfs/Ftp.php | 12 ++++++++----
framework/Vfs/lib/Horde/Vfs/Mongo.php | 7 +++++++
framework/Vfs/lib/Horde/Vfs/Musql.php | 9 +++++----
framework/Vfs/lib/Horde/Vfs/Smb.php | 12 ++++++++----
framework/Vfs/lib/Horde/Vfs/Sql.php | 9 +++++----
framework/Vfs/lib/Horde/Vfs/SqlFile.php | 3 +++
framework/Vfs/lib/Horde/Vfs/Ssh2.php | 12 ++++++++----
framework/Vfs/package.xml | 2 +-
10 files changed, 81 insertions(+), 31 deletions(-)
http://github.com/horde/horde/commit/9198c3c8fac5e8b4213a3e5853281ce2439a5c08
open enhancement for that?
State ⇒ Not A Bug
4-5 times less. Simply put, Horde_Db is terribly inefficient.
Since that has nothing to do with VFS itself, closing this ticket.
Horde_Db would benefit from log fixes in
Ticket #10773, so that's astart. Better would probably be informing users that they should NOT
be using SQL VFS in production environments.
4, VFS kills much of the joy. Uploading a 1.2 MB attachment to IMP,
a call to VFS::write(), using a Postgresql DB backend, uses 35.5 MB
of memory. That is unacceptable.
the critical issue seems to instead be that Horde_Db does not accept
stream resources as input - it expects everything in strings. Which
is depressing - this is going to make tuning very difficult, and
pretty much makes Horde_Db the bottleneck when it comes to memory
usage improvements.
Priority ⇒ 2. Medium
Patch ⇒ No
Milestone ⇒
Queue ⇒ Horde Framework Packages
Summary ⇒ VFS Memory Usage
Type ⇒ Bug
State ⇒ Unconfirmed
4, VFS kills much of the joy. Uploading a 1.2 MB attachment to IMP, a
call to VFS::write(), using a Postgresql DB backend, uses 35.5 MB of
memory. That is unacceptable.
This ticket is partially related to
Ticket #10773- eliminatinglogging within the DB object reduces memory usage to 15 MB. Still too
high, but not as bad.