Repository navigation

GH-32123: [R] Expose azure blob filesystem - #49553

Merged

jonkeane merged 89 commits into

apache:mainfrom

marberts:32123-expose-azure-blob-filesystem

Jul 13, 2026

Merged

GH-32123: [R] Expose azure blob filesystem#49553
jonkeane merged 89 commits into
apache:mainfrom
marberts:32123-expose-azure-blob-filesystem

Commits on Jul 10, 2026
- Add AzureBlobFileSystem placeholder, verify devtools::document() behaves correctly.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  76db447
- add simple test function to work through codegen.R
  
  Collinbrown95
  authored and
  jonkeane
  committed
  943cbfe
- temporarily "force" build DARROW_R_WITH_AZUREFS build flag.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  5a40fde
- Added c++ stub
  
  marberts
  authored and
  jonkeane
  committed
  4681b41
- Updated codegen
  
  marberts
  authored and
  jonkeane
  committed
  5769649
- Added a comment
  
  marberts
  authored and
  jonkeane
  committed
  2dbf5c7
- cleanup azurefs test function code
  
  Collinbrown95
  authored and
  jonkeane
  committed
  936ee78
- document instructions to start local azurite container
  
  Collinbrown95
  authored and
  jonkeane
  committed
  778c606
- add arrow_with_azure helper following convention for s3/gcp
  
  Collinbrown95
  authored and
  jonkeane
  committed
  83ea378
- add ARROW_AZURE flag to nixlibs.R
  
  Collinbrown95
  authored and
  jonkeane
  committed
  33de88c
- debug first argument check
  
  Collinbrown95
  authored and
  jonkeane
  committed
  38e4492
- Renamed R6 class correctly
  
  marberts
  authored and
  jonkeane
  committed
  8ba0eaa
- Added endpoint + key, token, and default authentication
  
  marberts
  authored and
  jonkeane
  committed
  cbbd654
- Finished logical for AzureFileSystem to match pyarrow
  
  marberts
  authored and
  jonkeane
  committed
  878a450
- standardize on ARROW_R_WITH_AZURE instead of ARROW_R_WITH_AZUREFS
  
  Collinbrown95
  authored and
  jonkeane
  committed
  9134cb7
- standardize on ARROW_R_WITH_AZURE
  
  Collinbrown95
  authored and
  jonkeane
  committed
  0ac57a8
- Turn on ARROW_AZURE flag in nixlibs.R
  
  Collinbrown95
  authored and
  jonkeane
  committed
  e8fcd43
- drop temporary arrow env var hack
  
  Collinbrown95
  authored and
  jonkeane
  committed
  8ffc149
- temporary documentation of what I've tried so far
  
  Collinbrown95
  authored and
  jonkeane
  committed
  517750d
- Add TODO note in configure script to remove hard-coded link flags
  
  Collinbrown95
  authored and
  jonkeane
  committed
  8bf5b05
- initial filesystem tests
  
  Collinbrown95
  authored and
  jonkeane
  committed
  cc79940
- uncomment line 256 of filesystem.cpp
  
  Collinbrown95
  authored and
  jonkeane
  committed
  b5d0703
- checkpoint: resolved segfault error
  
  Collinbrown95
  authored and
  jonkeane
  committed
  96e3744
- skip test_filesystem tests that rely on being able to connect directly with URI with Azure.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  d365ac3
- Add most test cases from test_filesystem and recreate a couple that were skipped because of the URI issue.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  f274b46
- rename az_bucket to az_container
  
  Collinbrown95
  authored and
  jonkeane
  committed
  4e70734
- check that azurite is installed as precondition for test-azure.R script.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  89e9adc
- add setup code to start azurite from the test-azure.R script, then kill the azurite process in a cleanup step.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  9bf81a5
- run air formatter
  
  Collinbrown95
  authored and
  jonkeane
  committed
  835879b
- add documentation to az_container.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  cf1a3b5
- docs: Updated documentation for AzureFileSystem and updated vignette (#1)
  
  marberts
  authored and
  jonkeane
  committed
  321de88
- Updated installation vignettes to include Azure
  
  marberts
  authored and
  jonkeane
  committed
  bab125a
- Updated install scripts
  
  marberts
  authored and
  jonkeane
  committed
  e93645f
- add tests for valid and invalid combinations of options to AzureFileSystem$create method
  
  Collinbrown95
  authored and
  jonkeane
  committed
  6f70268
- Ran pre-commit hooks
  
  marberts
  authored and
  jonkeane
  committed
  1c886cd
- Removed tmp.md
  
  marberts
  authored and
  jonkeane
  committed
  0e87a5d
- wrap credential configuration methods with StopIfNotOk
  
  Collinbrown95
  authored and
  jonkeane
  committed
  143a129
- move link flags to arrow_built_with ARROW_AZURE block in configure script
  
  Collinbrown95
  authored and
  jonkeane
  committed
  dbb33a4
- fix error message to check in test for empty call to AzureFileSystem$create()
  
  Collinbrown95
  authored and
  jonkeane
  committed
  9137668
- Updated docs to include libxml2
  
  marberts
  authored and
  jonkeane
  committed
  4501816
- add simple test function to work through codegen.R
  
  Collinbrown95
  authored and
  jonkeane
  committed
  e2654af
- cleanup azurefs test function code
  
  Collinbrown95
  authored and
  jonkeane
  committed
  6e20676
- Updated filesystem.cpp
  
  marberts
  authored and
  jonkeane
  committed
  d09817b
- Updated build scripts
  
  marberts
  authored and
  jonkeane
  committed
  fa6cc9e
- Update configure.win: fix typo
  
  Collinbrown95
  authored and
  jonkeane
  committed
  cf1050a
- Updated CI setup scripts for windows
  
  marberts
  authored and
  jonkeane
  committed
  e71257c
- Trying PKGBUILD and windows build script again
  
  marberts
  authored and
  jonkeane
  committed
  51e01d4
- Updated PKGBUILD
  
  marberts
  authored and
  jonkeane
  committed
  e0a0a17
- debug ci: add azure dependencies that CI tries to build from source.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  7be0a70
- Removed tmp.md
  
  marberts
  authored and
  jonkeane
  committed
  0c3ff58
- add install script to build azure-sdk-for-cpp dependencies from source.
  
  Collin Brown
  authored and
  jonkeane
  committed
  7d1aad9
- add simple test function to work through codegen.R
  
  Collinbrown95
  authored and
  jonkeane
  committed
  8d1c841
- temporarily "force" build DARROW_R_WITH_AZUREFS build flag.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  d3ce08d
- Added c++ stub
  
  marberts
  authored and
  jonkeane
  committed
  68c01e0
- cleanup azurefs test function code
  
  Collinbrown95
  authored and
  jonkeane
  committed
  7d29231
- document instructions to start local azurite container
  
  Collinbrown95
  authored and
  jonkeane
  committed
  3892e4c
- debug first argument check
  
  Collinbrown95
  authored and
  jonkeane
  committed
  f7c049f
- Added endpoint + key, token, and default authentication
  
  marberts
  authored and
  jonkeane
  committed
  bc9e0d9
- Finished logical for AzureFileSystem to match pyarrow
  
  marberts
  authored and
  jonkeane
  committed
  9931e26
- standardize on ARROW_R_WITH_AZURE
  
  Collinbrown95
  authored and
  jonkeane
  committed
  a39c227
- temporary documentation of what I've tried so far
  
  Collinbrown95
  authored and
  jonkeane
  committed
  8f3df68
- Add TODO note in configure script to remove hard-coded link flags
  
  Collinbrown95
  authored and
  jonkeane
  committed
  1106490
- uncomment line 256 of filesystem.cpp
  
  Collinbrown95
  authored and
  jonkeane
  committed
  e784d61
- checkpoint: resolved segfault error
  
  Collinbrown95
  authored and
  jonkeane
  committed
  17fc26e
- Add most test cases from test_filesystem and recreate a couple that were skipped because of the URI issue.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  cb86452
- check that azurite is installed as precondition for test-azure.R script.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  69065d6
- Ran pre-commit hooks
  
  marberts
  authored and
  jonkeane
  committed
  a6301e1
- Removed tmp.md
  
  marberts
  authored and
  jonkeane
  committed
  1d50661
- wrap credential configuration methods with StopIfNotOk
  
  Collinbrown95
  authored and
  jonkeane
  committed
  263b462
- move link flags to arrow_built_with ARROW_AZURE block in configure script
  
  Collinbrown95
  authored and
  jonkeane
  committed
  cb19431
- add simple test function to work through codegen.R
  
  Collinbrown95
  authored and
  jonkeane
  committed
  3486281
- cleanup azurefs test function code
  
  Collinbrown95
  authored and
  jonkeane
  committed
  2bc10ba
- Trying PKGBUILD and windows build script again
  
  marberts
  authored and
  jonkeane
  committed
  169ca19
- Updated PKGBUILD
  
  marberts
  authored and
  jonkeane
  committed
  d39eef4
- debug ci: add azure dependencies that CI tries to build from source.
  
  Collinbrown95
  authored and
  jonkeane
  committed
  fb850f1
- Removed tmp.md
  
  marberts
  authored and
  jonkeane
  committed
  7619f01
- Removed windows build and added macos
  
  marberts
  authored and
  jonkeane
  committed
  ff68542
- azure off for windows ci
  
  marberts
  authored and
  jonkeane
  committed
  9ea60df
- Disable azure in configure.win
  
  marberts
  authored and
  jonkeane
  committed
  5a3eed4
- Add placeholder comment to flag present issues with MinGW and the Azure C++ SDK
  
  Collinbrown95
  authored and
  jonkeane
  committed
  8f5d9ba
- remove debugging script to install azure sdk from source
  
  Collinbrown95
  authored and
  jonkeane
  committed
  addcfa5
- Updated vignettes to reflect Azure off on Windows
  
  marberts
  authored and
  jonkeane
  committed
  b58fcc5
- Update github.packages.yml
  
  marberts
  authored and
  jonkeane
  committed
  d5cd943
- Fixing lint in filesystem.cpp
  
  marberts
  authored and
  jonkeane
  committed
  211c1fc
- Fixed warning in cpp code
  
  marberts
  authored and
  jonkeane
  committed
  c7dd3e5
- Added build info for azure to tasks for mac + a couple code comments
  
  marberts
  authored and
  jonkeane
  committed
  24c918b
- Fixed line endings on github.packages yaml
  
  marberts
  authored and
  jonkeane
  committed
  a8ad6a9
- libxml2 warning in with_cloud_support() is now conditional on azure being requested
  
  marberts
  authored and
  jonkeane
  committed
  84f3b74
- Add libxml2
  jonkeane
  committed
  9dd6793

Commits

Commits on Jul 10, 2026