Container appears to mount sucessfully ....but isn't

[D-R-C-65]

I'm having trouble mounting some Azure Blob Storage to a RHEL 8.2 server. The mount command returns nothing and if I look through the log output it appears to have mounted sucessfully..... If however you run blobfuse2 mount list it returns nothing.

None of the files in the blob storage container are visible and whilst I can create a file in /blobfusemnt/bronze/ it is created locally not on the Azure storage.

The output from the mount command sudo blobfuse2 mount /blobfusemnt/bronze/ --config-file=/blobfusemnt/config/blobfuse.yaml is as follows:

Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_CRIT [mount.go (403)]: Starting Blobfuse2 Mount : 2.1.2 on [Red Hat Enterprise Linux 8.2 (Ootpa)]
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_CRIT [mount.go (404)]: Logging level set to : LOG_DEBUG
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [libfuse.go (253)]: Libfuse::Configure : libfuse
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [libfuse.go (244)]: Libfuse::Validate : UID 0, GID 0
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [libfuse.go (305)]: Libfuse::Configure : read-only false, allow-other true, allow-root false, default-perm 511, entry-timeout 120, attr-time 120, negative-timeout 240, ignore-open-flags true, nonempty false, direct_io false
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [file_cache.go (210)]: FileCache::Configure : file_cache
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [file_cache.go (289)]: FileCache::Configure : Using default eviction policy
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [file_cache.go (316)]: FileCache::Configure : create-empty false, cache-timeout 120, tmp-path /blobfusemnt/cache, max-size-mb 0, high-mark 80, low-mark 60, refresh-sec 0, max-eviction 5000, hard-limit false
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [attr_cache.go (126)]: AttrCache::Configure : attr_cache
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [attr_cache.go (156)]: AttrCache::Configure : cache-timeout 7200, symlink false, cache-on-list true
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [azstorage.go (84)]: AzStorage::Configure : azstorage
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [config.go (284)]: ParseAndValidateConfig : Parsing config
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [config.go (388)]: ParseAndValidateConfig : using the following proxy address from the config file: 
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [config.go (392)]: ParseAndValidateConfig : sdk logging from the config file: true
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [config.go (499)]: ParseAndReadDynamicConfig : Reparsing config
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_DEBUG [config.go (399)]: ParseAndValidateConfig : Getting auth type
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [config.go (485)]: ParseAndValidateConfig : Account: #########, Container: bronze, AccountType: BLOCK, Auth: SAS, Prefix: , Endpoint: https://#########.blob.core.windows.net/, List Block: 0, MD5 : false  false, Virtual Directory: true, Max Results For List 2, Disable Compression: false
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [config.go (489)]: ParseAndValidateConfig : Retry Config: Retry count 5, Max Timeout 900, BackOff Time 4, Max Delay 60
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [config.go (492)]: ParseAndValidateConfig : Telemetry : , Honour ACL: false, disable symlink: true
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [block_blob.go (173)]: BlockBlob::SetupPipeline : Setting up
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [block_blob.go (135)]: BlockBlob::getCredential : Getting credential
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_DEBUG [azauth.go (80)]: azAuth::getAzAuth : Account: #########, AccountType: BLOCK, Protocol: https, Endpoint: https://#########.blob.core.windows.net/
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [block_blob.go (260)]: BlockBlob::SetPrefixPath : path 
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_TRACE [block_blob.go (209)]: BlockBlob::TestPipeline : Validating
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [utils.go (238)]: SDK : ==> OUTGOING REQUEST (Try=1)
   GET https://#########.blob.core.windows.net/bronze?comp=list&delimiter=%2F&maxresults=2&restype=container&se=2023-00-00T11%3A52%3A00Z&sig=REDACTED&sp=racwdlm&sr=c&st=2023-00-00T11%3A52%3A00Z&sv=2020-02-10&timeout=901
   User-Agent: [Azure-Storage-Fuse/2.1.2 (Red Hat Enterprise Linux 8.2 (Ootpa)) Azure-Storage/0.15 (go1.20.5; linux)]
   X-Ms-Client-Request-Id: [50fd8aec-075d-494d-6959-06327c18b1c4]
   X-Ms-Version: [2020-10-02]

Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [utils.go (238)]: SDK : ==> REQUEST/RESPONSE (Try=1/16.104446ms, OpTime=25.782075ms) -- RESPONSE SUCCESSFULLY RECEIVED
   GET https://#########.blob.core.windows.net/bronze?comp=list&delimiter=%2F&maxresults=2&restype=container&se=2023-00-00T11%3A52%3A00Z&sig=REDACTED&sp=racwdlm&sr=c&st=2023-00-00T11%3A52%3A00Z&sv=2020-02-10&timeout=901
   User-Agent: [Azure-Storage-Fuse/2.1.2 (Red Hat Enterprise Linux 8.2 (Ootpa)) Azure-Storage/0.15 (go1.20.5; linux)]
   X-Ms-Client-Request-Id: [50fd8aec-075d-494d-6959-06327c18b1c4]
   X-Ms-Version: [2020-10-02]
   --------------------------------------------------------------------------------
   RESPONSE Status: 200 OK
   Content-Type: [application/xml]
   Date: [Tue, 19 Dec 2023 16:26:01 GMT]
   Server: [Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0]
   X-Ms-Client-Request-Id: [50fd8aec-075d-494d-6959-06327c18b1c4]
   X-Ms-Request-Id: [1d796981-301e-001f-0298-32d83b000000]
   X-Ms-Version: [2020-10-02]

Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [mount.go (413)]: mount: Mounting blobfuse2 on /blobfusemnt/bronze
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_DEBUG [mount.go (451)]: mount: foreground disabled, child = false
Tue Dec 19 16:25:55 UTC 2023 : blobfuse2[554047] : LOG_INFO [mount.go (465)]: mount: Child [554057] mounted successfully at /blobfusemnt/bronze

The config for this is:

allow-other: true

logging:
  type: base
  level: log_debug
  file-path: /blobfusemnt/logs/blobfuse.log

components:
  - libfuse
  - file_cache
  - attr_cache
  - azstorage

libfuse:
  attribute-expiration-sec: 120
  entry-expiration-sec: 120
  negative-entry-expiration-sec: 240

attr_cache:
  timeout-sec: 7200

file_cache:
  path: /blobfusemnt/cache
  allow-non-empty-temp: true
  cleanup-on-start: true

azstorage:
  sdk-trace: true
  type: block
  account-name: ########
  container: bronze
  endpoint: https://########.blob.core.windows.net
  mode: sas
  #Key1 in use
  sas: ?sv=##################################################################

I've been through a number of threads and the only reference I can see to it appearing to mount but not, relates to AV and I can confirm the above was done without any AV software enabled.

HNS is enabled on the storage.

I'm hoping for some ideas as I'm now starting to get dizzy going round in circles ! 😕

[ashruti-msft]

Hey David,
Please change type: block to type: adls for azstorage in the config file as the storage has HNS enabled. This parameter describes the type of storage account connected.
Let me know if you encounter any problems after this.