Linux:
Problem
Memory allocation and resource (buffer and image) creation in Vulkan is difficult (comparing to older graphics APIs, like D3D11 or OpenGL) for several reasons:
- It requires a lot of boilerplate code, just like everything else in Vulkan, because it is a low-level and high-performance API.
- There is additional level of indirection:
VkDeviceMemory
is allocated separately from creating VkBuffer
/VkImage
and they must be bound together. - Driver must be queried for supported memory heaps and memory types. Different GPU vendors provide different types of it.
- It is recommended to allocate bigger chunks of memory and assign parts of them to particular resources, as there is a limit on maximum number of memory blocks that can be allocated.
Features
This library can help game developers to manage memory allocations and resource creation by offering some higher-level functions:
- Functions that help to choose correct and optimal memory type based on intended usage of the memory.
- Required or preferred traits of the memory are expressed using higher-level description comparing to Vulkan flags.
- Functions that allocate memory blocks, reserve and return parts of them (
VkDeviceMemory
+ offset + size) to the user.- Library keeps track of allocated memory blocks, used and unused ranges inside them, finds best matching unused ranges for new allocations, respects all the rules of alignment and buffer/image granularity.
- Functions that can create an image/buffer, allocate memory for it and bind them together - all in one call.
Additional features:
- Well-documented - description of all functions and structures provided, along with chapters that contain general description and example code.
- Thread-safety: Library is designed to be used in multithreaded code. Access to a single device memory block referred by different buffers and textures (binding, mapping) is synchronized internally. Memory mapping is reference-counted.
- Configuration: Fill optional members of
VmaAllocatorCreateInfo
structure to provide custom CPU memory allocator, pointers to Vulkan functions and other parameters. - Customization and integration with custom engines: Predefine appropriate macros to provide your own implementation of all external facilities used by the library like assert, mutex, atomic.
- Support for memory mapping, reference-counted internally. Support for persistently mapped memory: Just allocate with appropriate flag and access the pointer to already mapped memory.
- Support for non-coherent memory. Functions that flush/invalidate memory.
nonCoherentAtomSize
is respected automatically. - Support for resource aliasing (overlap).
- Support for sparse binding and sparse residency: Convenience functions that allocate or free multiple memory pages at once.
- Custom memory pools: Create a pool with desired parameters (e.g. fixed or limited maximum size) and allocate memory out of it.
- Linear allocator: Create a pool with linear algorithm and use it for much faster allocations and deallocations in free-at-once, stack, double stack, or ring buffer fashion.
- Support for Vulkan 1.0, 1.1, 1.2, 1.3.
- Support for extensions (and equivalent functionality included in new Vulkan versions):
- VK_KHR_dedicated_allocation: Just enable it and it will be used automatically by the library.
- VK_KHR_buffer_device_address: Flag
VK_MEMORY_ALLOCATE_DEVICE_ADDRESS_BIT_KHR
is automatically added to memory allocations where needed. - VK_EXT_memory_budget: Used internally if available to query for current usage and budget. If not available, it falls back to an estimation based on memory heap sizes.
- VK_EXT_memory_priority: Set
priority
of allocations or custom pools and it will be set automatically using this extension. - VK_AMD_device_coherent_memory
- Defragmentation of GPU and CPU memory: Let the library move data around to free some memory blocks and make your allocations better compacted.
- Statistics: Obtain brief or detailed statistics about the amount of memory used, unused, number of allocated blocks, number of allocations etc. - globally, per memory heap, and per memory type.
- Debug annotations: Associate custom
void* pUserData
and debug char* pName
with each allocation. - JSON dump: Obtain a string in JSON format with detailed map of internal state, including list of allocations, their string names, and gaps between them.
- Convert this JSON dump into a picture to visualize your memory. See tools/GpuMemDumpVis.
- Debugging incorrect memory usage: Enable initialization of all allocated memory with a bit pattern to detect usage of uninitialized or freed memory. Enable validation of a magic number after every allocation to detect out-of-bounds memory corruption.
- Support for interoperability with OpenGL.
- Virtual allocator: Interface for using core allocation algorithm to allocate any custom data, e.g. pieces of one large buffer.
Prerequisites
- Self-contained C++ library in single header file. No external dependencies other than standard C and C++ library and of course Vulkan. Some features of C++14 used. STL containers, RTTI, or C++ exceptions are not used.
- Public interface in C, in same convention as Vulkan API. Implementation in C++.
- Error handling implemented by returning
VkResult
error codes - same way as in Vulkan. - Interface documented using Doxygen-style comments.
- Platform-independent, but developed and tested on Windows using Visual Studio. Continuous integration setup for Windows and Linux. Used also on Android, MacOS, and other platforms.
Example
Basic usage of this library is very simple. Advanced features are optional. After you created global VmaAllocator
object, a complete code needed to create a buffer may look like this:
VkBufferCreateInfo bufferInfo = { VK_STRUCTURE_TYPE_BUFFER_CREATE_INFO };
bufferInfo.size = 65536;
bufferInfo.usage = VK_BUFFER_USAGE_VERTEX_BUFFER_BIT | VK_BUFFER_USAGE_TRANSFER_DST_BIT;
VmaAllocationCreateInfo allocInfo = {};
allocInfo.usage = VMA_MEMORY_USAGE_AUTO;
VkBuffer buffer;
VmaAllocation allocation;
vmaCreateBuffer(allocator, &bufferInfo, &allocInfo, &buffer, &allocation, nullptr);
With this one function call:
VkBuffer
is created.VkDeviceMemory
block is allocated if needed.- An unused region of the memory block is bound to this buffer.
VmaAllocation
is an object that represents memory assigned to this buffer. It can be queried for parameters like VkDeviceMemory
handle and offset.
How to build
On Windows it is recommended to use CMake UI. Alternatively you can generate a Visual Studio project map using CMake in command line: cmake -B./build/ -DCMAKE_BUILD_TYPE=Debug -G "Visual Studio 16 2019" -A x64 ./
On Linux:
mkdir build
cd build
cmake ..
make
The following targets are available
Target | Description | CMake option | Default setting |
---|
VmaSample | VMA sample application | VMA_BUILD_SAMPLE | OFF |
VmaBuildSampleShaders | Shaders for VmaSample | VMA_BUILD_SAMPLE_SHADERS | OFF |
Please note that while VulkanMemoryAllocator library is supported on other platforms besides Windows, VmaSample is not.
These CMake options are available
CMake option | Description | Default setting |
---|
VMA_RECORDING_ENABLED | Enable VMA memory recording for debugging | OFF |
VMA_USE_STL_CONTAINERS | Use C++ STL containers instead of VMA's containers | OFF |
VMA_STATIC_VULKAN_FUNCTIONS | Link statically with Vulkan API | OFF |
VMA_DYNAMIC_VULKAN_FUNCTIONS | Fetch pointers to Vulkan functions internally (no static linking) | ON |
VMA_DEBUG_ALWAYS_DEDICATED_MEMORY | Every allocation will have its own memory block | OFF |
VMA_DEBUG_INITIALIZE_ALLOCATIONS | Automatically fill new allocations and destroyed allocations with some bit pattern | OFF |
VMA_DEBUG_GLOBAL_MUTEX | Enable single mutex protecting all entry calls to the library | OFF |
VMA_DEBUG_DONT_EXCEED_MAX_MEMORY_ALLOCATION_COUNT | Never exceed VkPhysicalDeviceLimits::maxMemoryAllocationCount and return error | OFF |
Building using vcpkg
You can download and install VulkanMemoryAllocator using the vcpkg dependency manager:
git clone https://github.com/Microsoft/vcpkg.git
cd vcpkg
./bootstrap-vcpkg.sh
./vcpkg integrate install
./vcpkg install vulkan-memory-allocator
The VulkanMemoryAllocator port in vcpkg is kept up to date by Microsoft team members and community contributors. If the version is out of date, please create an issue or pull request on the vcpkg repository.
Binaries
The release comes with precompiled binary executable for “VulkanSample” application which contains test suite. It is compiled using Visual Studio 2019, so it requires appropriate libraries to work, including “MSVCP140.dll”, “VCRUNTIME140.dll”, “VCRUNTIME140_1.dll”. If the launch fails with error message telling about those files missing, please download and install Microsoft Visual C++ Redistributable for Visual Studio 2015, 2017 and 2019, “x64” version.
Read more
See Documentation.
Software using this library
Many other projects on GitHub and some game development studios that use Vulkan in their games.
See also
- D3D12 Memory Allocator - equivalent library for Direct3D 12. License: MIT.
- Awesome Vulkan - a curated list of awesome Vulkan libraries, debuggers and resources.
- vcpkg dependency manager from Microsoft also offers a port of this library.
- VulkanMemoryAllocator-Hpp - C++ binding for this library. License: CC0-1.0.
- PyVMA - Python wrapper for this library. Author: Jean-Sébastien B. (@realitix). License: Apache 2.0.
- vk-mem - Rust binding for this library. Author: Graham Wihlidal. License: Apache 2.0 or MIT.
- Haskell bindings, github - Haskell bindings for this library. Author: Ellie Hermaszewska (@expipiplus1). License BSD-3-Clause.
- vma_sample_sdl - SDL port of the sample app of this library (with the goal of running it on multiple platforms, including MacOS). Author: @rextimmy. License: MIT.
- vulkan-malloc - Vulkan memory allocation library for Rust. Based on version 1 of this library. Author: Dylan Ede (@dylanede). License: MIT / Apache 2.0.