summaryrefslogtreecommitdiffstats
path: root/lib/libmemstat
Commit message (Collapse)AuthorAgeFilesLines
* Refine UMA bucket allocation to reduce space consumption and improvejeff2013-06-181-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | performance. - Always free to the alloc bucket if there is space. This gives LIFO allocation order to improve hot-cache performance. This also allows for zones with a single bucket per-cpu rather than a pair if the entire working set fits in one bucket. - Enable per-cpu caches of buckets. To prevent recursive bucket allocation one bucket zone still has per-cpu caches disabled. - Pick the initial bucket size based on a table driven maximum size per-bucket rather than the number of items per-page. This gives more sane initial sizes. - Only grow the bucket size when we face contention on the zone lock, this causes bucket sizes to grow more slowly. - Adjust the number of items per-bucket to account for the header space. This packs the buckets more efficiently per-page while making them not quite powers of two. - Eliminate the per-zone free bucket list. Always return buckets back to the bucket zone. This ensures that as zones grow into larger bucket sizes they eventually discard the smaller sizes. It persists fewer buckets in the system. The locking is slightly trickier. - Only switch buckets in zalloc, not zfree, this eliminates pathological cases where we ping-pong between two buckets. - Ensure that the thread that fills a new bucket gets to allocate from it to give a better upper bound on allocation time. Sponsored by: EMC / Isilon Storage Division
* Const-ify the zone name argument to uma_zcreate(9).mdf2012-10-261-1/+1
| | | | MFC after: 3 days
* Fix various typos in manual pages.gjb2012-02-251-2/+2
| | | | | | Submitted by: amdmi3 PR: 165431 MFC after: 1 week
* Cosmetic cleanup: remove #define LIBMEMSTAT used to prevent a nestedpluknet2011-09-021-1/+0
| | | | | | | | include of opt_vmpage.h from vm/vm_page.h. opt_vmpage.h was retired before 7.0 together with options PQ_NOOPT. Approved by: re (kib) MFC after: 3 days
* Get rid of MAXCPU knowledge used for internal needs only. Switch topluknet2011-08-016-64/+41
| | | | | | | | | | | dynamic memory allocation to hold per-CPU memory types data (sized to mp_maxid for UMA, and to mp_maxcpus for malloc to match the kernel). That fixes libmemstat with arbitrary large MAXCPU values and therefore eliminates MEMSTAT_ERROR_TOOMANYCPUS error type. Reviewed by: jhb Approved by: re (kib)
* Revert r222363, as bde@ pointed out the initial solution was far moreattilio2011-05-311-1/+1
| | | | correct.
* Style fix: cast to size_t rather than u_long when comparing to sizeof()attilio2011-05-271-1/+1
| | | | | | rets. Requested by: kib
* Sync with -CURRENTattilio2011-05-101-1/+1
|
* Fix a mismerge.attilio2011-05-081-0/+1
|
* Revert MAXCPU introduction. In userland it is always 1.attilio2011-05-085-10/+20
| | | | Noted by: marcel
* Commit the support for removing cpumask_t and replacing it directly withattilio2011-05-051-1/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | cpuset_t objects. That is going to offer the underlying support for a simple bump of MAXCPU and then support for number of cpus > 32 (as it is today). Right now, cpumask_t is an int, 32 bits on all our supported architecture. cpumask_t on the other side is implemented as an array of longs, and easilly extendible by definition. The architectures touched by this commit are the following: - amd64 - i386 - pc98 - arm - ia64 - XEN while the others are still missing. Userland is believed to be fully converted with the changes contained here. Some technical notes: - This commit may be considered an ABI nop for all the architectures different from amd64 and ia64 (and sparc64 in the future) - per-cpu members, which are now converted to cpuset_t, needs to be accessed avoiding migration, because the size of cpuset_t should be considered unknown - size of cpuset_t objects is different from kernel and userland (this is primirally done in order to leave some more space in userland to cope with KBI extensions). If you need to access kernel cpuset_t from the userland please refer to example in this patch on how to do that correctly (kgdb may be a good source, for example). - Support for other architectures is going to be added soon - Only MAXCPU for amd64 is bumped now The patch has been tested by sbruno and Nicholas Esborn on opteron 4 x 12 pack CPUs. More testing on big SMP is expected to came soon. pluknet tested the patch with his 8-ways on both amd64 and i386. Tested by: pluknet, sbruno, gianni, Nicholas Esborn Reviewed by: jeff, jhb, sbruno
* Remove the redefinition of MEMSTAT_MAXCPU and just use MAXCPU for that.attilio2011-05-025-23/+12
| | | | Reviewed by: sbruno
* MFC @ r221286attilio2011-05-011-3/+4
|
* Spelling fixes.joel2010-08-031-2/+2
|
* Add a new column to the output of vmstat -z to indicate the numbersbruno2010-06-154-0/+12
| | | | | | | | | | | | | of times the system was forced to sleep when requesting a new allocation. Expand the debugger hook, db_show_uma, to display these results as well. This has proven to be very useful in out of memory situations when it is not known why systems have become sluggish or fail in odd ways. Reviewed by: rwatson alc Approved by: scottl (mentor) peter Obtained from: Yahoo Inc.
* mdoc: order prologue macros consistently by Dd/Dt/Osuqs2010-04-141-1/+1
| | | | | | | | Although groff_mdoc(7) gives another impression, this is the ordering most widely used and also required by mdocml/mandoc. Reviewed by: ru Approved by: philip, ed (mentors)
* Bump the version of all non-symbol-versioned shared libraries inkensmith2009-07-191-1/+1
| | | | | | | | preparation for 8.0-RELEASE. Add the previous version of those libraries to ObsoleteFiles.inc and bump __FreeBSD_Version. Reviewed by: kib Approved by: re (rwatson)
* Update the KVM backend for malloc stats to catch up to the internal structurejhb2009-05-151-6/+5
| | | | | | BI change from the addition of DTrace malloc(9) probes. Submitted by: Ben Kelly ben of wanderview dot com
* Make pointer argument to kread_string() const since the kernel structurerwatson2007-05-211-3/+4
| | | | | | | field is const, and then employ __DECONST before getting into the kvm code. This eliminates a gcc 4.2 warning about losing constification. __DECONST advice from: sam
* Bump library versions in preparation for 7.0.deischen2007-05-211-1/+1
| | | | Ok'd by: kan
* Fix a comment in memstat.h: errors are associated with memory type lists,rwatson2007-03-151-1/+1
| | | | | | | not individual types. Submitted by: Bryan Venteicher <bryanv at daemoninthecloset dot org> MFC after: 3 days
* Increase the number of CPUs to 32 to suit sun4v.jb2006-07-261-1/+1
| | | | Reviewed by: rwatson@
* Update copyright for 2006.rwatson2006-02-111-1/+1
| | | | MFC after: 3 days
* The uma_zone data structure defines the size of its uz_cpu[] array as 1,rwatson2006-02-111-2/+24
| | | | | | | | | | | | | but then sizes the containing data structure at run-time to make room for per-cpu cache data. Modify libmemstat to separately allocate a buffer to hold per-cpu cache data, sized based on the run-time mp_maxid variable when using libkvm to access UMA data. This avoids reading invalid cache data from beyond the end of the uma_zone data structure on the stack, which can result in invalid statistics and/or reads from invalid kernel addresses. Foot target practice by: ps MFC after: 3 days
* When reporting an error reading from UMA per-cpu cache pointers using KVM,rwatson2006-02-111-4/+2
| | | | | | | | return a KVM error rather than an out of memory error, so that the caller reports the KVM error state. This replaces a misleading error message with a more accurate although equally confusing one. MFC after: 3 days
* Read all_cpus variable out of kmem, and validate CPUs against the all_cpusrwatson2006-02-111-0/+10
| | | | | | | | cpu mask before looking at the cache entries for the CPU. For systems with sparse CPU id arrays, this skips otherwise uninitialized cache structures. MFC after: 3 days
* Correct a typo in the extraction of zone information from UMA using kmem:rwatson2006-02-111-1/+1
| | | | | | bytes = allocated - freed, not bytes = allocated = freed. MFC after: 3 days
* Remove unnecessary and undesirable 'static' from function-local kegrwatson2006-01-161-1/+1
| | | | | | | | list, which could cause problems for multi-threaded applications using libmemstat to monitor UMA in more than one thread simultaneously. MFC after: 3 days
* Tidy up markup and fix two bugs.ru2005-11-211-77/+93
|
* Add symlinks for kvm access methods for memstat(3).rwatson2005-11-131-0/+3
| | | | MFC after: 3 days
* Add missing shared library interdependencies.ru2005-11-101-0/+2
|
* The "Mbuf" zone was renamed "mbuf" to improve consistency, but the coderwatson2005-08-151-4/+4
| | | | | | | | | example in libmemstat.3 was not updated to take this rename into account. Update the example. PR: 84946 Submitted by: Wojciech A. Koszek <dunstan at freebsd dot czest dot pl> MFC after: 1 day
* Document kvm(3)-related error constants, and correct minor formattingrwatson2005-08-091-2/+20
| | | | nits.
* Teach libmemstat(3) how to extract malloc(9) statistics using kvm(3),rwatson2005-08-064-7/+190
| | | | | | | | | so that libmemstat can be used to view full memory statistics from kernel core dumps and /dev/mem. This is provided via a new query function, memstat_kvm_malloc(), which is also automatically invoked by memstat_kvm_all(). A kvm handle must be passed in. This will allow malloc(9)-specific code to be removed from vmstat(8).
* Define LIBMEMSTAT so that vm_page.h won't perform a nested include ofrwatson2005-08-041-9/+1
| | | | | | | | | opt_vmpage.h. Remove definition of _KERNEL, it is no longer required in order to include uma_int.h, as the sensitive parts of uma_int.h (a number of inlines depending on kernel-only constants) are now protected by _KERNEL.
* Add memstat_kvm_uma(), an implementation of a libmemstat(3) query routinerwatson2005-08-015-2/+248
| | | | | | | | | | | | that knows how to extract UMA(9) allocator statistics from a core dump or live memory image using kvm(3). The caller is expected to provide the necessary kvm_t handle, which is then used by libmemstat(3). With these changes, it is trivially straight forward to re-introduce vmstat -z support on core dumps, which was lost when UMA was introduced. In the short term, this requires including vm/ include files that are not intended for extra-kernel use, requiring in turn some ugliness.
* Correct two libmemstat(3) bugs:rwatson2005-08-014-4/+12
| | | | | | | | | | | | | | | | | | - Move memory_type_list flushing logic from memstat_mtl_free() to _memstat_mtl_empty(), a libmemstat-internal function that can be called from other parts of the library. Invoke _memstat_mtl_empty() from memstat_mtl_free(), which also frees the containing list structure. Invoke _memstat_mtl_empty() instead of memstat_mtl_free() in various error cases in memstat_malloc.c and memstat_uma.c, which previously resulted in the list being freed prematurely. - Reverse the order of updating the mt_kegfree and mt_free fields of the memory_type in memstat_uma.c, otherwise keg free items won't be counted properly for non-secondary zones. MFC after: 3 days
* If a retrieved UMA zone is a secondary zone, don't report keg free items,rwatson2005-07-251-1/+10
| | | | | | | as they actually belong to the primary zone, and maye otherwise be reported more than once. MFC after: 1 day
* Having decided not to provide a libmemstat(3) error number to textrwatson2005-07-244-3/+38
| | | | | | | | | | | | | conversion routine, now change my mind and add one, memstat_strerror(3), which returns a const char * pointer to a string describing the error, to be used on the results of memstat_mtl_geterror(). While here, also correct a minor typo in the HISTORY man page. Pointers on improving ease of internationalization would be appreciated. MFC after: 1 day
* Document additional aspects of libmemstat(3):rwatson2005-07-242-0/+171
| | | | | | | | - Short description of each memory type access method. - Descriptions of libmemstat(3) errors and memstat_mtl_geterror(3). MFC after: 1 day
* Introduce more formal error handling for libmemstat(3):rwatson2005-07-245-66/+78
| | | | | | | | | | | | | | | | | | | | | | | | | | | - Define a set of libmemstat(3) error constants, which are used by all libmemstat(3) methods except for memstat_mtl_alloc(), which allocates a memory type list and may return ENOMEM via errno. - Define a per-memory_type_list current error value, which is set when a call associated with a memory list fails. This requires wrapping a structure around the queue(9) list head data structure, but this change is not visible to libmemstat(3) consumers due to using access methods. - Add a new accessor method, memstat_mtl_geterror() to retrieve the error number. - Consistently set the error number in a number of failure modes where previously some combination of setting errno and printf'ing error descriptions was used. libmemstat(3) will now no longer print to stdio under any circumstances. Returns of NULL/-1 for errors remain the same. This avoids use of stdio, misuse of error numbers, and should make it easier to program a libmemstat(3) consumer able to print useful error messages. Currently, no error-to-string function is provided, as I'm unsure how to address internationalization concerns. MFC after: 1 day
* Prefix two non-static libmemstat(3) internal functions with '_' symbols, torwatson2005-07-234-19/+12
| | | | | | | try and discourage use outside the library. Remove duplicate declaration of memstat_mtl_free() from memstat_internal.h, as it's not internal, and the memstat.h definition suffices.
* UMA supports "secondary" zones, in which a second zone can be layeredrwatson2005-07-205-1/+14
| | | | | | | | | | | | | | | | | | | | | | | | on top of a primary zone, sharing the same allocation "keg". When reporting statistics for zones, do not report the free items in the keg as part of the free items in the zone, or those free items will be reported more than once: for the primary zone, and then any secondary zones off the primary zone. Separately record and maintain a kegfree statistic, and export via memstat_get_kegfree(), which is available for use if needed. Since items free'd back to the keg are not fully initialized, and hence may not actually be available (since secondary zone ctor-time initialization can fail), this makes some amount of sense. This change corrects a bug made visible in the libmemstat(3) modifications to netstat: mbufs freed back to the keg from the packet zone would be counted twice, resulting in negative values being printed in the mbuf free count. Some further refinement of reporting relating to secondary zones may still be required. Reported by: ssouhlal MFC after: 3 days
* Bump MEMSTAT_MAXCALLER to 16. memtop(8) seems to be able to happilyrwatson2005-07-181-1/+1
| | | | | | | consume that many slots to track snapshot-to-snapshot changes and running totals. And 16 is a nice round number. MFC after: 1 week
* Add __BEGIN_DECLS and __END_DECLS to make libmemstat(3) more C++-friendly.rwatson2005-07-171-0/+2
| | | | MFC after: 1 week
* Teach libmemstat(3) about UMA(9) failure statistics.rwatson2005-07-151-0/+1
| | | | | Requested by: victor cruceru <victor dot cruceru at gmail dot com> MFC after: 1 week
* Provide more documentation on caller-owned storage in struct memory_type,rwatson2005-07-151-7/+20
| | | | | | as well as documenting MEMSTAT_MAXCALLER. MFC after: 1 week
* Increase the number of caller memory storage slots from 2 or 4 torwatson2005-07-152-8/+12
| | | | | | | | | | | | MEMSTAT_MAXCALLER (8), and expose MEMSTAT_MAXCALLER via memstat.h so that applications can check their assumptions about how many slots are available. Remove 'spare' memory storage in struct malloc_type, since we now don't expose the data structure internals to applications and rely on accessor methods, this approach to ABI stability isn't required. MFC after: 7 days
* Add a section on the allocator name space and its interactions withrwatson2005-07-151-0/+22
| | | | | | memstat_mtl_find(). MFC after: 10 days
* Re-spell wronge less wrongly as wrong.rwatson2005-07-152-4/+4
| | | | | Submitted by: jkoshy MFC after: 1 week
OpenPOWER on IntegriCloud