You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

BitmapIndex.java 5.8KB

Added read/write support for pack bitmap index. A pack bitmap index is an additional index of compressed bitmaps of the object graph. Furthermore, a logical API of the index functionality is included, as it is expected to be used by the PackWriter. Compressed bitmaps are created using the javaewah library, which is a word-aligned compressed variant of the Java bitset class based on run-length encoding. The library only works with positive integer values. Thus, the maximum number of ObjectIds in a pack file that this index can currently support is limited to Integer.MAX_VALUE. Every ObjectId is given an integer mapping. The integer is the position of the ObjectId in the complete ObjectId list, sorted by offset, for the pack file. That integer is what the bitmaps use to reference the ObjectId. Currently, the new index format can only be used with pack files that contain a complete closure of the object graph e.g. the result of a garbage collection. The index file includes four bitmaps for the Git object types i.e. commits, trees, blobs, and tags. In addition, a collection of bitmaps keyed by an ObjectId is also included. The bitmap for each entry in the collection represents the full closure of ObjectIds reachable from the keyed ObjectId (including the keyed ObjectId itself). The bitmaps are further compressed by XORing the current bitmaps against prior bitmaps in the index, and selecting the smallest representation. The XOR'd bitmap and offset from the current entry to the position of the bitmap to XOR against is the actual representation of the entry in the index file. Each entry contains one byte, which is currently used to note whether the bitmap should be blindly reused. Change-Id: Id328724bf6b4c8366a088233098c18643edcf40f
11 years ago
123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190
  1. /*
  2. * Copyright (C) 2012, Google Inc.
  3. * and other copyright owners as documented in the project's IP log.
  4. *
  5. * This program and the accompanying materials are made available
  6. * under the terms of the Eclipse Distribution License v1.0 which
  7. * accompanies this distribution, is reproduced below, and is
  8. * available at http://www.eclipse.org/org/documents/edl-v10.php
  9. *
  10. * All rights reserved.
  11. *
  12. * Redistribution and use in source and binary forms, with or
  13. * without modification, are permitted provided that the following
  14. * conditions are met:
  15. *
  16. * - Redistributions of source code must retain the above copyright
  17. * notice, this list of conditions and the following disclaimer.
  18. *
  19. * - Redistributions in binary form must reproduce the above
  20. * copyright notice, this list of conditions and the following
  21. * disclaimer in the documentation and/or other materials provided
  22. * with the distribution.
  23. *
  24. * - Neither the name of the Eclipse Foundation, Inc. nor the
  25. * names of its contributors may be used to endorse or promote
  26. * products derived from this software without specific prior
  27. * written permission.
  28. *
  29. * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND
  30. * CONTRIBUTORS "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES,
  31. * INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES
  32. * OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE
  33. * ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
  34. * CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
  35. * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT
  36. * NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
  37. * LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
  38. * CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
  39. * STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
  40. * ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF
  41. * ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
  42. */
  43. package org.eclipse.jgit.lib;
  44. import java.util.Iterator;
  45. import org.eclipse.jgit.storage.file.PackBitmapIndex;
  46. /** A compressed bitmap representation of the entire object graph. */
  47. public interface BitmapIndex {
  48. /**
  49. * Get the bitmap for the id. The returned bitmap is immutable and the
  50. * bitwise operations return the result of the operation in a new Bitmap.
  51. *
  52. * @param objectId
  53. * the object ID
  54. * @return the Bitmap for the objectId or null, if one does not exist.
  55. */
  56. Bitmap getBitmap(AnyObjectId objectId);
  57. /** @return a new {@code BitmapBuilder} based on the values in the index. */
  58. BitmapBuilder newBitmapBuilder();
  59. /**
  60. * A bitmap representation of ObjectIds that can be iterated to return the
  61. * underlying {@code ObjectId}s or operated on with other {@code Bitmap}s.
  62. */
  63. public interface Bitmap extends Iterable<BitmapObject> {
  64. /**
  65. * Bitwise-OR the current bitmap with the value from the other
  66. * bitmap.
  67. *
  68. * @param other
  69. * the other bitmap
  70. * @return a bitmap that is the bitwise-OR.
  71. */
  72. Bitmap or(Bitmap other);
  73. /**
  74. * Bitwise-AND-NOT the current bitmap with the value from the other
  75. * bitmap.
  76. *
  77. * @param other
  78. * the other bitmap
  79. * @return a bitmap that is the bitwise-AND-NOT.
  80. */
  81. Bitmap andNot(Bitmap other);
  82. /**
  83. * Bitwise-XOR the current bitmap with the value from the other
  84. * bitmap.
  85. *
  86. * @param other
  87. * the other bitmap
  88. * @return a bitmap that is the bitwise-XOR.
  89. */
  90. Bitmap xor(Bitmap other);
  91. /**
  92. * Returns an iterator over a set of elements of type BitmapObject. The
  93. * BitmapObject instance is reused across calls to
  94. * {@link Iterator#next()} for performance reasons.
  95. *
  96. * @return an Iterator.
  97. */
  98. Iterator<BitmapObject> iterator();
  99. }
  100. /**
  101. * A builder for a bitmap. The bitwise operations update the builder and
  102. * return a reference to the current builder.
  103. */
  104. public interface BitmapBuilder extends Bitmap {
  105. /**
  106. * Adds the id and the existing bitmap for the id, if one exists, to the
  107. * bitmap.
  108. *
  109. * @param objectId
  110. * the object ID
  111. * @param type
  112. * the Git object type. See {@link Constants}.
  113. * @return true if the value was not contained or able to be loaded.
  114. */
  115. boolean add(AnyObjectId objectId, int type);
  116. /**
  117. * Whether the bitmap has the id set.
  118. *
  119. * @param objectId
  120. * the object ID
  121. * @return whether the bitmap currently contains the object ID
  122. */
  123. boolean contains(AnyObjectId objectId);
  124. /**
  125. * Remove the id from the bitmap.
  126. *
  127. * @param objectId
  128. * the object ID
  129. */
  130. void remove(AnyObjectId objectId);
  131. /**
  132. * Bitwise-OR the current bitmap with the value from the other bitmap.
  133. *
  134. * @param other
  135. * the other bitmap
  136. * @return the current builder.
  137. */
  138. BitmapBuilder or(Bitmap other);
  139. /**
  140. * Bitwise-AND-NOT the current bitmap with the value from the other
  141. * bitmap.
  142. *
  143. * @param other
  144. * the other bitmap
  145. * @return the current builder.
  146. */
  147. BitmapBuilder andNot(Bitmap other);
  148. /**
  149. * Bitwise-XOR the current bitmap with the value from the other bitmap.
  150. *
  151. * @param other
  152. * the other bitmap
  153. * @return the current builder.
  154. */
  155. BitmapBuilder xor(Bitmap other);
  156. /** @return the fully built immutable bitmap */
  157. Bitmap build();
  158. /**
  159. * Determines if the entire bitmap index is contained in the bitmap. If
  160. * it is, the matching bits are removed from the bitmap and true is
  161. * returned. If the bitmap index is null, false is returned.
  162. *
  163. * @param bitmapIndex
  164. * the bitmap index to check if it is completely contained
  165. * inside of the current bitmap.
  166. * @return {@code true} if the bitmap index was a complete match.
  167. */
  168. boolean removeAllOrNone(PackBitmapIndex bitmapIndex);
  169. /** @return the number of elements in the bitmap. */
  170. int cardinality();
  171. }
  172. }