No source files found in compile args error #199

davidzchen · 2024-06-13T10:17:17Z

I recently started getting a No source files found in compile args error while running refresh_compile_commands. The error message told me to file an issue for this.

Repository is here: https://github.com/davidzchen/bazel-ycm-test

bazel run :refresh_compile_commands
WARNING: Build options --cxxopt, --features, and --host_features have changed, discarding analysis cache (this can be expensive, see https://bazel.build/advanced/performance/iteration-speed).
INFO: Analyzed target //:refresh_compile_commands (0 packages loaded, 3077 targets configured).
INFO: Found 1 target...
Target //:refresh_compile_commands up-to-date:
  bazel-bin/refresh_compile_commands
  bazel-bin/refresh_compile_commands.check_python_version.py
  bazel-bin/refresh_compile_commands.py
INFO: Elapsed time: 0.252s, Critical Path: 0.00s
INFO: 1 process: 1 internal.
INFO: Build completed successfully, 1 total action
INFO: Running command line: bazel-bin/refresh_compile_commands
>>> Analyzing commands used in //...
WARNING: Build options --cxxopt, --features, and --host_features have changed, discarding analysis cache (this can be expensive, see https://bazel.build/advanced/performance/iteration-speed).
Traceback (most recent call last):
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/refresh_compile_commands.runfiles/_main/refresh_compile_commands.check_python_version.py", line 15, in <module>
    refresh_compile_commands.main()
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/refresh_compile_commands.runfiles/_main/refresh_compile_commands.py", line 1422, in main
    compile_command_entries.extend(_get_commands(target, flags))
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/refresh_compile_commands.runfiles/_main/refresh_compile_commands.py", line 1284, in _get_commands
    yield from _convert_compile_commands(parsed_aquery_output)
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/refresh_compile_commands.runfiles/_main/refresh_compile_commands.py", line 1164, in _convert_compile_commands
    for source_files, header_files, compile_command_args in outputs:
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/external/rules_python~~python~python_3_11_aarch64-apple-darwin/lib/python3.11/concurrent/futures/_base.py", line 619, in result_iterator
    yield _result_or_cancel(fs.pop())
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/external/rules_python~~python~python_3_11_aarch64-apple-darwin/lib/python3.11/concurrent/futures/_base.py", line 317, in _result_or_cancel
    return fut.result(timeout)
           ^^^^^^^^^^^^^^^^^^^
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/external/rules_python~~python~python_3_11_aarch64-apple-darwin/lib/python3.11/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/external/rules_python~~python~python_3_11_aarch64-apple-darwin/lib/python3.11/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/external/rules_python~~python~python_3_11_aarch64-apple-darwin/lib/python3.11/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/refresh_compile_commands.runfiles/_main/refresh_compile_commands.py", line 1128, in _get_cpp_command_for_files
    source_files, header_files = _get_files(compile_action)
                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/private/var/tmp/_bazel_dzc/ca3f78bcbc408bb12abbe25f7a083ec0/execroot/_main/bazel-out/darwin_arm64-fastbuild/bin/refresh_compile_commands.runfiles/_main/refresh_compile_commands.py", line 626, in _get_files
    assert source_file_candidates, f"No source files found in compile args: {compile_action.arguments}.\nPlease file an issue with this information!"
AssertionError: No source files found in compile args: ['external/bazel_tools~cc_configure_extension~local_config_cc/cc_wrapper.sh', '-xc++-header', '-fsyntax-only', '-U_FORTIFY_SOURCE', '-fstack-protector', '-Wall', '-Wthread-safety', '-Wself-assign', '-Wunused-but-set-parameter', '-Wno-free-nonheap-object', '-fcolor-diagnostics', '-fno-omit-frame-pointer', '-std=c++14', '-MD', '-MF', 'bazel-out/darwin_arm64-fastbuild/bin/external/abseil-cpp~/absl/strings/_objs/strings/ascii.h.d', '-iquote', 'external/abseil-cpp~', '-iquote', 'bazel-out/darwin_arm64-fastbuild/bin/external/abseil-cpp~', '-mmacosx-version-min=14.4', '-std=c++20', '-Wall', '-Wextra', '-Wcast-qual', '-Wconversion', '-Wfloat-overflow-conversion', '-Wfloat-zero-conversion', '-Wfor-loop-analysis', '-Wformat-security', '-Wgnu-redeclared-enum', '-Winfinite-recursion', '-Winvalid-constexpr', '-Wliteral-conversion', '-Wmissing-declarations', '-Woverlength-strings', '-Wpointer-arith', '-Wself-assign', '-Wshadow-all', '-Wshorten-64-to-32', '-Wsign-conversion', '-Wstring-conversion', '-Wtautological-overlap-compare', '-Wtautological-unsigned-zero-compare', '-Wundef', '-Wuninitialized', '-Wunreachable-code', '-Wunused-comparison', '-Wunused-local-typedefs', '-Wunused-result', '-Wvla', '-Wwrite-strings', '-Wno-float-conversion', '-Wno-implicit-float-conversion', '-Wno-implicit-int-float-conversion', '-Wno-unknown-warning-option', '-DNOMINMAX', '-no-canonical-prefixes', '-Wno-builtin-macro-redefined', '-D__DATE__="redacted"', '-D__TIMESTAMP__="redacted"', '-D__TIME__="redacted"', '-c', 'external/abseil-cpp~/absl/strings/ascii.h', '-o', 'bazel-out/darwin_arm64-fastbuild/bin/external/abseil-cpp~/absl/strings/_objs/strings/ascii.h.processed'].
Please file an issue with this information!

System Info

OS: macOS 14.4.1 Sonoma

Bazel/Bazelisk version:

$ bazel version
Bazelisk version: 1.20.0
Build label: 7.2.0
Build target: @@//src/main/java/com/google/devtools/build/lib/bazel:BazelServer
Build time: Mon Jun 10 13:04:55 2024 (1718024695)
Build timestamp: 1718024695
Build timestamp as int: 1718024695

Python version:

$ python3 --version
Python 3.12.3

The text was updated successfully, but these errors were encountered:

xiedeacc · 2024-06-15T14:24:30Z

same error

ehuang3 · 2024-06-16T18:04:14Z

I also have this issue. The logic in _get_files(compile_action) does not seem to support a header only compile command. There are no source files because the command is attempting to precompile a header file.

ehuang3 · 2024-06-16T18:31:07Z

diff --git a/refresh.template.py b/refresh.template.py
index 3b33701..acc5f90 100644
--- a/refresh.template.py
+++ b/refresh.template.py
@@ -615,6 +615,11 @@ def _get_files(compile_action):
 
     # Getting the source file is a little trickier than it might seem.
 
+    is_precompiled_header = any([arg == "-xc++-header" for arg in compile_action.arguments])
+    if is_precompiled_header:
+        header_files = [arg for arg in compile_action.arguments if not arg.startswith('-') and arg.endswith(".h")]
+        return set(), set(header_files)
+
     # First, we do the obvious thing: Filter args to those that look like source files.
     source_file_candidates = [arg for arg in compile_action.arguments if not arg.startswith('-') and arg.endswith(_get_files.source_extensions)]
     assert source_file_candidates, f"No source files found in compile args: {compile_action.arguments}.\nPlease file an issue with this information!"

This patch works for me.

davidzchen · 2024-06-16T20:04:17Z

That's odd. I had cc_library targets that only had headers in the past, and the tool ran just fine. Something caused this error to come up recently, but I do not know what changed on my system, aside from maybe Bazel getting updated (I am using bazelisk but I don't have Bazel pinned to a specific version in my repo).

davidzchen · 2024-06-16T20:08:46Z

In any case, this patched worked for me as well. @ehuang3 can you open a PR?

tolikzinovyev · 2024-06-27T15:11:25Z

I started having the same problem in my project. The error also triggers on abseil's header file. I created a small repository so that reproducing is easier. https://github.com/tolikzinovyev/hedron-fail

Arch Linux, Bazel 7.2.0

xiedeacc · 2024-06-28T21:48:51Z

I started having the same problem in my project. The error also triggers on abseil's header file. I created a small repository so that reproducing is easier. https://github.com/tolikzinovyev/hedron-fail

Arch Linux, Bazel 7.2.0
use
https://github.com/xiedeacc/bazel-compile-commands-extractor

davidzchen · 2024-06-29T05:10:57Z

Can someone please open a PR for this?

cpsauer · 2024-06-29T05:36:05Z

Hey guys--I'm seeing this and will engage with it shortly, aiming for this weekend. Sorry to be only getting to this now; I've been underwater with other things.

Seems like bazel added a new type of header-only compile action, when formerly they only issued them for source files. I think the first step is to understand what's going on in those actions to make sure there aren't other problems and figure out if there's another way to distinguish them (in case the problem happens also with, e.g. c (not c++) headers, breaking the solution above).

Awesome to have a minimal reproduction case and know the Bazel version that broke it--thanks guys.

If anyone is willing to help in the meantime, I think the next steps would be

Try to dig up the context behind this Bazel change.
Make sure it's still happening in Bazel rolling, if we can't find that context.
Look at the aquery output for those actions to try to understand them better.

rockwotj · 2024-08-01T14:50:30Z

Likely Related PR: bazelbuild/bazel#22369

rockwotj · 2024-08-01T14:57:57Z

I've also confirmed this still happens in Bazel rolling at least for abseil in my repo

Had to downgrade Bazel to 7.1.2 because it was crashing when building abseil. See issue: hedronvision/bazel-compile-commands-extractor#199

helly25 · 2024-08-18T17:54:30Z

I ran into the same issue on one of my repos. And got it working with #209

The problem is that the source file a header (.h) cannot be found as it is not in the list of source files. There is a PR out that addresses the exact combination: #205

That one also adds support for .h.processed as a target.

However, it does not support all header extension variants ('.hh', '.hpp', '.hxx' and whatnot). So it might be necessary to adding them all and to only use .processed as additional target extension.

rockwotj · 2024-08-20T02:03:13Z

@fmeum sorry to pull you into this, but I believe that bazelbuild/bazel#22369 caused this (because downgrading to Bazel 7.1.0 makes this error go away). Do you know the details of the purpose of the .processed headers are for? Since they are new in 7.2.0, I presume it's safe for a compilation database to just skip adding compilation commands for clangd for these .processed headers. Thanks!

fmeum · 2024-08-20T07:13:15Z

The .processed file is just a synthetic output file that's always empty: Bazel can't run actions that produce no outputs, so the way we get it to run on headers is to wrap the compiler with a script that produces this empty file.

While the file itself isn't interesting, the action very well could be. For a header-only library with no consumers, it does provide flags with which the library at least parses correctly. That makes an approach such as #209 look reasonable to me.

I am working on adding a new action that supports C headers (via -xc-header), but this hasn't been merged yet.

helly25 · 2024-08-20T09:16:20Z

Thanks for confirming @fmeum. The header only libraries get their own entries this way. Which imo is a clear improvement.

andreiavrammsd · 2024-09-18T03:37:43Z

I have this issue if I use boost.move:

MODULE.bazel

bazel_dep(name = "boost.move", version="1.83.0")

BUILD

cc_library(
    name = "lib",
    hdrs = [
        "include/lib.hpp",
    ],
    includes = ["include"],
    visibility = ["//visibility:public"],
    deps = [
        "@boost.move",
    ],
)

bazel-compile-commands-extractor commit:

1e08f8e0507b6b6b1f4416a9a22cf5c28beaba93

Error

Traceback (most recent call last):
  File "/home/user/.cache/bazel/_bazel_user/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/bin/external/hedron_compile_commands~/refresh_all.runfiles/_main/../hedron_compile_commands~/refresh_all.check_python_version.py", line 15, in <module>
    refresh_all.main()
  File "/home/user/.cache/bazel/_bazel_user/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/bin/external/hedron_compile_commands~/refresh_all.py", line 1417, in main
    compile_command_entries.extend(_get_commands(target, flags))
  File "/home/user/.cache/bazel/_bazel_user/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/bin/external/hedron_compile_commands~/refresh_all.py", line 1279, in _get_commands
    yield from _convert_compile_commands(parsed_aquery_output)
  File "/home/user/.cache/bazel/_bazel_user/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/bin/external/hedron_compile_commands~/refresh_all.py", line 1159, in _convert_compile_commands
    for source_files, header_files, compile_command_args in outputs:
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 621, in result_iterator
    yield _result_or_cancel(fs.pop())
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 319, in _result_or_cancel
    return fut.result(timeout)
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 451, in result
    return self.__get_result()
  File "/usr/lib/python3.10/concurrent/futures/_base.py", line 403, in __get_result
    raise self._exception
  File "/usr/lib/python3.10/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/home/user/.cache/bazel/_bazel_user/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/bin/external/hedron_compile_commands~/refresh_all.py", line 1123, in _get_cpp_command_for_files
    source_files, header_files = _get_files(compile_action)
  File "/home/user/.cache/bazel/_bazel_user/eab0d61a99b6696edb3d2aff87b585e8/execroot/_main/bazel-out/k8-fastbuild/bin/external/hedron_compile_commands~/refresh_all.py", line 627, in _get_files
    assert source_file_candidates, f"No source files found in compile args: {compile_action.arguments}.\nPlease file an issue with this information!"
AssertionError: No source files found in compile args: ['external/bazel_tools~cc_configure_extension~local_config_cc/cc_wrapper.sh', '-xc++-header', '-fsyntax-only', '-U_FORTIFY_SOURCE', '-fstack-protector', '-Wall', '-Wthread-safety', '-Wself-assign', '-Wunused-but-set-parameter', '-Wno-free-nonheap-object', '-fcolor-diagnostics', '-fno-omit-frame-pointer', '-g', '-std=c++14', '-MD', '-MF', 'bazel-out/k8-dbg/bin/external/boost.move~/_objs/boost.move/adl_move_swap.h.d', '-iquote', 'external/boost.move~', '-iquote', 'bazel-out/k8-dbg/bin/external/boost.move~', '-iquote', 'external/boost.config~', '-iquote', 'bazel-out/k8-dbg/bin/external/boost.config~', '-isystem', 'external/boost.move~/include', '-isystem', 'bazel-out/k8-dbg/bin/external/boost.move~/include', '-isystem', 'external/boost.config~/include', '-isystem', 'bazel-out/k8-dbg/bin/external/boost.config~/include', '-g', '-O0', '-no-canonical-prefixes', '-Wno-builtin-macro-redefined', '-D__DATE__="redacted"', '-D__TIMESTAMP__="redacted"', '-D__TIME__="redacted"', '-c', 'external/boost.move~/include/boost/move/adl_move_swap.hpp', '-o', 'bazel-out/k8-dbg/bin/external/boost.move~/_objs/boost.move/adl_move_swap.h.processed'].
Please file an issue with this information!

mikael-s-persson · 2024-09-18T15:46:26Z

I've been using the following patch for this issue: #219
That's been working pretty well for us.

andreiavrammsd · 2024-09-19T02:16:37Z

I've been using the following patch for this issue: #219 That's been working pretty well for us.

I confirm it works in my case.

davidzchen added a commit to davidzchen/bazel-compile-commands-extractor that referenced this issue Jun 16, 2024

Apply patch from hedronvision#199.

616a578

xiedeacc mentioned this issue Jun 18, 2024

No source files found in compile args #200

Closed

agegechkori added a commit to agegechkori/bazel-compile-commands-extractor that referenced this issue Jun 24, 2024

Applied patch from hedronvision#199.

810dad8

rockwotj mentioned this issue Aug 1, 2024

No source files found in compile args #204

Open

rockwotj mentioned this issue Aug 9, 2024

Command extractor crash report #206

Open

helly25 linked a pull request Aug 18, 2024 that will close this issue

Add pre-processed header support. #209

Open

mikael-s-persson linked a pull request Sep 18, 2024 that will close this issue

Fix for header-only compile actions by Bazel #219

Open

stonebrakert6 mentioned this issue Oct 8, 2024

refresh_compile_commands fails #226

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

No source files found in compile args error #199

No source files found in compile args error #199

davidzchen commented Jun 13, 2024

xiedeacc commented Jun 15, 2024

ehuang3 commented Jun 16, 2024

ehuang3 commented Jun 16, 2024

davidzchen commented Jun 16, 2024

davidzchen commented Jun 16, 2024

tolikzinovyev commented Jun 27, 2024

xiedeacc commented Jun 28, 2024

davidzchen commented Jun 29, 2024

cpsauer commented Jun 29, 2024

rockwotj commented Aug 1, 2024

rockwotj commented Aug 1, 2024

helly25 commented Aug 18, 2024

rockwotj commented Aug 20, 2024

fmeum commented Aug 20, 2024

helly25 commented Aug 20, 2024

andreiavrammsd commented Sep 18, 2024

mikael-s-persson commented Sep 18, 2024

andreiavrammsd commented Sep 19, 2024

No source files found in compile args error #199

No source files found in compile args error #199

Comments

davidzchen commented Jun 13, 2024

System Info

xiedeacc commented Jun 15, 2024

ehuang3 commented Jun 16, 2024

ehuang3 commented Jun 16, 2024

davidzchen commented Jun 16, 2024

davidzchen commented Jun 16, 2024

tolikzinovyev commented Jun 27, 2024

xiedeacc commented Jun 28, 2024

davidzchen commented Jun 29, 2024

cpsauer commented Jun 29, 2024

rockwotj commented Aug 1, 2024

rockwotj commented Aug 1, 2024

helly25 commented Aug 18, 2024

rockwotj commented Aug 20, 2024

fmeum commented Aug 20, 2024

helly25 commented Aug 20, 2024

andreiavrammsd commented Sep 18, 2024

mikael-s-persson commented Sep 18, 2024

andreiavrammsd commented Sep 19, 2024