Add ABSL_SWISSTABLE_ASSUME_SEPARATE_STORAGE and use it in raw_hash_set::control().

Apparently, the manual assume we had with pointer values wasn't doing anything (we previously thought it was valuable but apparently the original change's codegen effects were side effects of e.g. calling `NumControlBytes(capacity())`).

Benefits of the new `ABSL_SWISSTABLE_ASSUME_SEPARATE_STORAGE(ctrl, this)` in `raw_hash_set::control()`:

* Unlike the previous `reinterpret_cast<uintptr_t>` range comparison inside `ABSL_ASSUME` (which LLVM's `BasicAA` ignores), `__builtin_assume_separate_storage(ctrl, this)` lowers to an `@llvm.assume` `"separate_storage"` operand bundle that `BasicAA` directly uses to prove that pointers derived from `ctrl` (including `slot_array` and iterator slot pointers on the non-SOO path) cannot alias `*this` (or any enclosing object containing the table).

* When a caller mutates an element via an iterator returned by `find()` or `begin()` (e.g. `*it = v` or `it->second = v`), the compiler can now prove that the store to the slot does not clobber `CommonFields` metadata (`size`, `capacity`, `seed` in `0(%rdi)`), eliminating redundant reloads of `CommonFields` (and freeing `this` earlier to reduce register pressure) across subsequent `size()`, `capacity()`, or `find()` operations.

Benefits of removing the previous assume from `CommonFields::control()` on `raw_hash_set_benchmark` (`--config=benchmark --cpu=haswell`, `llvm-mca -mcpu=znver3`):

* `raw_hash_set::find`: Removing `NumControlBytes(capacity())` from `CommonFields::control()` allows `prefetcht2` (`prefetch_heap_block()`) to be scheduled immediately after loading `ctrl` (`movq 8(%rdi), %rax`), ahead of the capacity mask setup (`movq $-1, %r8; shlxq %rdx, %r8, %rcx`).

* Under `llvm-mca -mcpu=znver3 -iterations=1`, this promotes `prefetcht2` from the second dispatch group (cycle 1) into the first dispatch group (cycle 0) while leaving static L1-hit latency unchanged (36 cycles for `CodegenAbslRawHashSetInt64Find`, 37 cycles for `CodegenAbslRawHashSetInt64FindNeEnd`, 143 cycles for `StringTable::find`), and avoids a stack spill in `DescriptorByNameHash` `raw_hash_set::find<string_view>` (133 → 131 cycles, RThroughput 29.7 → 29.3).

* `raw_hash_set.cc` (`CommonFields`): Removing `reinterpret_cast<uintptr_t>(this)` from `CommonFields::control()` allows LLVM argument promotion on `ReportInsertMissToInfoz` (11 → 8 instructions, 15 → 10 cycles at `-iterations=1`) and slightly reduces instruction counts in `ResizeAllocatedTableWithSeedChange` (377 → 374 instructions, 244 → 243 cycles) and `EraseMetaOnlyLarge` (78 → 77 instructions, RThroughput 13.7 → 13.3).

PiperOrigin-RevId: 1003430109
1 file changed
tree: ca320d1881f7d104ffc0c49b2794bdfaed071327
  1. .github/
  2. absl/
  3. ci/
  4. CMake/
  5. .bazelrc
  6. .clang-format
  7. .gitignore
  8. ABSEIL_ISSUE_TEMPLATE.md
  9. AUTHORS
  10. BUILD.bazel
  11. CMakeLists.txt
  12. conanfile.py
  13. CONTRIBUTING.md
  14. create_lts.py
  15. FAQ.md
  16. LICENSE
  17. MODULE.bazel
  18. PrivacyInfo.xcprivacy
  19. README.md
  20. UPGRADES.md
README.md

Abseil - C++ Common Libraries

The repository contains the Abseil C++ library code. Abseil is an open-source collection of C++ code (compliant to C++17) designed to augment the C++ standard library.

Table of Contents

About Abseil

Abseil is an open-source collection of C++ library code designed to augment the C++ standard library. The Abseil library code is collected from Google's own C++ code base, has been extensively tested and used in production, and is the same code we depend on in our daily coding lives.

In some cases, Abseil provides pieces missing from the C++ standard; in others, Abseil provides alternatives to the standard for special needs we've found through usage in the Google code base. We denote those cases clearly within the library code we provide you.

Abseil is not meant to be a competitor to the standard library; we've just found that many of these utilities serve a purpose within our code base, and we now want to provide those resources to the C++ community as a whole.

Quickstart

If you want to just get started, make sure you at least run through the Abseil Quickstart. The Quickstart contains information about setting up your development environment, downloading the Abseil code, running tests, and getting a simple binary working.

Building Abseil

Bazel and CMake are the official build systems for Abseil. See the quickstart for more information on building Abseil using the Bazel build system. If you require CMake support, please check the CMake build instructions and CMake Quickstart.

Support

Abseil follows Google's Foundational C++ Support Policy. See this table for a list of currently supported versions compilers, platforms, and build tools.

Codemap

Abseil contains the following C++ library components:

  • base
    The base library contains initialization code and other code which all other Abseil code depends on. Code within base may not depend on any other code (other than the C++ standard library).
  • algorithm
    The algorithm library contains additions to the C++ <algorithm> library and container-based versions of such algorithms.
  • cleanup
    The cleanup library contains the control-flow-construct-like type absl::Cleanup which is used for executing a callback on scope exit.
  • container
    The container library contains additional STL-style containers, including Abseil's unordered “Swiss table” containers.
  • crc The crc library contains code for computing error-detecting cyclic redundancy checks on data.
  • debugging
    The debugging library contains code useful for enabling leak checks, and stacktrace and symbolization utilities.
  • flags
    The flags library contains code for handling command line flags for libraries and binaries built with Abseil.
  • hash
    The hash library contains the hashing framework and default hash functor implementations for hashable types in Abseil.
  • log
    The log library contains LOG and CHECK macros and facilities for writing logged messages out to disk, stderr, or user-extensible destinations.
  • memory
    The memory library contains memory management facilities that augment C++'s <memory> library.
  • meta
    The meta library contains type checks similar to those available in the C++ <type_traits> library.
  • numeric
    The numeric library contains 128-bit integer types as well as implementations of C++20's bitwise math functions.
  • profiling
    The profiling library contains utility code for profiling C++ entities. It is currently a private dependency of other Abseil libraries.
  • random
    The random library contains functions for generating pseudorandom values.
  • status
    The status library contains abstractions for error handling, specifically absl::Status and absl::StatusOr<T>.
  • strings
    The strings library contains a variety of strings routines and utilities.
  • synchronization
    The synchronization library contains concurrency primitives (Abseil's absl::Mutex class, an alternative to std::mutex) and a variety of synchronization abstractions.
  • time
    The time library contains abstractions for computing with absolute points in time, durations of time, and formatting and parsing time within time zones.
  • types
    The types library contains non-container utility types.
  • utility
    The utility library contains utility and helper code.

Releases

Abseil recommends users “live-at-head” (update to the latest commit from the master branch as often as possible). However, we realize this philosophy doesn't work for every project, so we also provide Long Term Support Releases to which we backport fixes for severe bugs. See our release management document for more details.

License

The Abseil C++ library is licensed under the terms of the Apache license. See LICENSE for more information.

Links

For more information about Abseil: