Package org.elasticsearch.common.blobstore.fs

Class FsBlobContainer

java.lang.Object
org.elasticsearch.common.blobstore.support.AbstractBlobContainer
org.elasticsearch.common.blobstore.fs.FsBlobContainer
All Implemented Interfaces:
BlobContainer
public class FsBlobContainer extends AbstractBlobContainer
A file system based implementation of BlobContainer. All blobs in the container are stored on a file system, the location of which is specified by the BlobPath. Note that the methods in this implementation of BlobContainer may additionally throw a SecurityException if the configured SecurityManager does not permit read and/or write access to the underlying files.

  • Field Details

    • blobStore

      protected final FsBlobStore blobStore

    • path

      protected final Path path

  • Constructor Details

  • Method Details

    • listBlobs

      public Map<String,BlobMetadata> listBlobs() throws IOException
      Description copied from interface: BlobContainer
      Lists all blobs in the container.
      Returns:
      A map of all the blobs in the container. The keys in the map are the names of the blobs and the values are BlobMetadata, containing basic information about each blob.
      Throws:
      IOException - if there were any failures in reading from the blob container.

    • children

      public Map<String,BlobContainer> children() throws IOException
      Description copied from interface: BlobContainer
      Lists all child containers under this container. A child container is defined as a container whose BlobContainer.path() method returns a path that has this containers BlobContainer.path() return as its prefix and has one more path element than the current container's path.
      Returns:
      Map of name of the child container to child container
      Throws:
      IOException - on failure to list child containers

    • listBlobsByPrefix

      public Map<String,BlobMetadata> listBlobsByPrefix(String blobNamePrefix) throws IOException
      Description copied from interface: BlobContainer
      Lists all blobs in the container that match the specified prefix.
      Parameters:
      blobNamePrefix - The prefix to match against blob names in the container.
      Returns:
      A map of the matching blobs in the container. The keys in the map are the names of the blobs and the values are BlobMetadata, containing basic information about each blob.
      Throws:
      IOException - if there were any failures in reading from the blob container.

    • delete

      public DeleteResult delete() throws IOException
      Description copied from interface: BlobContainer
      Deletes this container and all its contents from the repository.
      Returns:
      delete result
      Throws:
      IOException - on failure

    • deleteBlobsIgnoringIfNotExists

      public void deleteBlobsIgnoringIfNotExists(Iterator<String> blobNames) throws IOException
      Description copied from interface: BlobContainer
      Deletes the blobs with given names. This method will not throw an exception when one or multiple of the given blobs don't exist and simply ignore this case.
      Parameters:
      blobNames - the names of the blobs to delete
      Throws:
      IOException - if a subset of blob exists but could not be deleted.

    • blobExists

      public boolean blobExists(String blobName)
      Description copied from interface: BlobContainer
      Tests whether a blob with the given blob name exists in the container.
      Parameters:
      blobName - The name of the blob whose existence is to be determined.
      Returns:
      true if a blob exists in the BlobContainer with the given name, and false otherwise.

    • readBlob

      public InputStream readBlob(String name) throws IOException
      Description copied from interface: BlobContainer
      Creates a new InputStream for the given blob name.
      Parameters:
      name - The name of the blob to get an InputStream for.
      Returns:
      The InputStream to read the blob.
      Throws:
      NoSuchFileException - if the blob does not exist
      IOException - if the blob can not be read.

    • readBlob

      public InputStream readBlob(String blobName, long position, long length) throws IOException
      Description copied from interface: BlobContainer
      Creates a new InputStream that can be used to read the given blob starting from a specific position in the blob. The length is an indication of the number of bytes that are expected to be read from the InputStream.
      Parameters:
      blobName - The name of the blob to get an InputStream for.
      position - The position in the blob where the next byte will be read.
      length - An indication of the number of bytes to be read.
      Returns:
      The InputStream to read the blob.
      Throws:
      NoSuchFileException - if the blob does not exist
      IOException - if the blob can not be read.

    • readBlobPreferredLength

      public long readBlobPreferredLength()
      Description copied from interface: BlobContainer
      Provides a hint to clients for a suitable length to use with BlobContainer.readBlob(String, long, long). Some blob containers have nontrivial costs attached to each readBlob call, so it is a good idea for consumers to speculatively request more data than they need right now and to re-use this stream for future needs if possible. Also, some blob containers return streams that are expensive to close before the stream has been fully consumed, and the cost may depend on the length of the data that was left unconsumed. For these containers it's best to bound the cost of a partial read by bounding the length of the data requested.
      Returns:
      a hint to consumers regarding the length of data to request if there is a good chance that future reads can be satisfied from the same stream.

    • writeBlob

      public void writeBlob(String blobName, InputStream inputStream, long blobSize, boolean failIfAlreadyExists) throws IOException
      Description copied from interface: BlobContainer
      Reads blob content from the input stream and writes it to the container in a new blob with the given name. This method assumes the container does not already contain a blob of the same blobName. If a blob by the same name already exists, the operation will fail and an IOException will be thrown.
      Parameters:
      blobName - The name of the blob to write the contents of the input stream to.
      inputStream - The input stream from which to retrieve the bytes to write to the blob.
      blobSize - The size of the blob to be written, in bytes. It is implementation dependent whether this value is used in writing the blob to the repository.
      failIfAlreadyExists - whether to throw a FileAlreadyExistsException if the given blob already exists
      Throws:
      FileAlreadyExistsException - if failIfAlreadyExists is true and a blob by the same name already exists
      IOException - if the input stream could not be read, or the target blob could not be written to.

    • writeBlob

      public void writeBlob(String blobName, BytesReference bytes, boolean failIfAlreadyExists) throws IOException
      Description copied from interface: BlobContainer
      Reads blob content from a BytesReference and writes it to the container in a new blob with the given name.
      Parameters:
      blobName - The name of the blob to write the contents of the input stream to.
      bytes - The bytes to write
      failIfAlreadyExists - whether to throw a FileAlreadyExistsException if the given blob already exists
      Throws:
      FileAlreadyExistsException - if failIfAlreadyExists is true and a blob by the same name already exists
      IOException - if the input stream could not be read, or the target blob could not be written to.

    • writeBlob

      public void writeBlob(String blobName, boolean failIfAlreadyExists, boolean atomic, org.elasticsearch.core.CheckedConsumer<OutputStream,IOException> writer) throws IOException
      Description copied from interface: BlobContainer
      Write a blob by providing a consumer that will write its contents to an output stream. This method allows serializing a blob's contents directly to the blob store without having to materialize the serialized version in full before writing.
      Parameters:
      blobName - the name of the blob to write
      failIfAlreadyExists - whether to throw a FileAlreadyExistsException if the given blob already exists
      atomic - whether the write should be atomic in case the implementation supports it
      writer - consumer for an output stream that will write the blob contents to the stream
      Throws:
      IOException

    • writeBlobAtomic

      public void writeBlobAtomic(String blobName, BytesReference bytes, boolean failIfAlreadyExists) throws IOException
      Description copied from interface: BlobContainer
      Reads blob content from a BytesReference and writes it to the container in a new blob with the given name, using an atomic write operation if the implementation supports it.
      Parameters:
      blobName - The name of the blob to write the contents of the input stream to.
      bytes - The bytes to write
      failIfAlreadyExists - whether to throw a FileAlreadyExistsException if the given blob already exists
      Throws:
      FileAlreadyExistsException - if failIfAlreadyExists is true and a blob by the same name already exists
      IOException - if the input stream could not be read, or the target blob could not be written to.

    • moveBlobAtomic

      public void moveBlobAtomic(String sourceBlobName, String targetBlobName, boolean failIfAlreadyExists) throws IOException
      Throws:
      IOException

    • tempBlobName

      public static String tempBlobName(String blobName)

    • isTempBlobName

      public static boolean isTempBlobName(String blobName)
      Returns true if the blob is a leftover temporary blob. The temporary blobs might be left after failed atomic write operation.