Glb file having different appearance

[mbalajee]

Gltf viewer online	Filament

Same gltf file appears differently on online viewer and Filament. What changes do I have to make to get the appearance from the online viewer?

• I have tried disabling all options in the debug view
• Removed the "materials" block from gltf file

Model: https://drive.google.com/drive/folders/175h337ECA1590Nk0mX5VRtnkJpL2xdHJ?usp=sharing

[romainguy]

@poweifeng Looks like we don't generate the normals properly. Didn't you fix this recently?

[poweifeng]

I did. But you'll have to enable this path explicitly. Let me write a response.

[poweifeng]

There is some background of this issue in #6358 .

To address your problem (specifically the gltf you're using). You can apply the following diff to samples/gltf_viewer.cpp

diff --git a/samples/gltf_viewer.cpp b/samples/gltf_viewer.cpp
index 80a06298e..91ae2c781 100644
--- a/samples/gltf_viewer.cpp
+++ b/samples/gltf_viewer.cpp
@@ -747,7 +747,16 @@ int main(int argc, char** argv) {
                 createJitShaderProvider(engine, OPTIMIZE_MATERIALS) :
                 createUbershaderProvider(engine, UBERARCHIVE_DEFAULT_DATA, UBERARCHIVE_DEFAULT_SIZE);

-        app.assetLoader = AssetLoader::create({engine, app.materials, app.names });
+        AssetConfigurationExtended ext = {
+            .gltfPath = filename.c_str(),
+        };
+        AssetConfiguration config = {
+            .engine = engine,
+            .materials = app.materials,
+            .names = app.names,
+            .ext = &ext,
+        };
+        app.assetLoader = AssetLoader::create(config);
         app.mainCamera = &view->getCamera();
         if (filename.isEmpty()) {
             app.asset = app.assetLoader->createAsset(

This is the output

The reason why this path is kind of hidden is that it has limitations such as only being able to handle local-to-disk gltfs. So it's not really ready for prime-time. To introduce the fix properly, we have a tracking issue #7782 to create a new API for gltf loading. Maybe this current workaround (adding the ext object) is enough for your use case?

[mbalajee]

Yeah I just created a new JNI function with an additional parameter for file path (we save models in Files directory not in Assets folder) and called the AssetLoader::create with the new extended config and it works

extern "C" JNIEXPORT jlong JNICALL
Java_com_google_android_filament_gltfio_AssetLoader_nCreateAssetLoaderExtended(JNIEnv* env, jclass,
                                                                       jlong nativeEngine, jobject provider, jlong nativeEntities, jstring filePath) {
    .....
    const char *nativeFilePath = env->GetStringUTFChars(filePath, nullptr);
    AssetConfigurationExtended ext = {
            .gltfPath = nativeFilePath
    };
    AssetConfiguration config = {
            .engine = engine,
            .materials = materialProvider,
            .names = names,
            .ext = &ext,
    };
    return (jlong) AssetLoader::create(config);
}

Any reason why this can't be built into the gltfio-android and filament-utils-android libraries? Because we would like to use filament as a dependency instead of building from source so it's easier to keep Filament updated

[mbalajee]

Ah spoke too soon... model appears all white, guess I'll need to make some changes in Utility.cpp#loadCgltfBuffers

[mbalajee]

I changed conditions that was excluding code path for Android platform and I put debug points on the code changes in the fix PR & they're all executing. Model still appears fully in white and no shadows, changes in Indirect light & other color related properties Debug view does not affect the appearance (remains white) but if i disable View post processing it goes all black. It appears correctly in gltf_viewer.cpp app. Do I need to make any other change?

@poweifeng

[mbalajee]

Here are some logs, that I added in AssetLoader and ResourceLoader, from running on Android,

FEngine (64 bits) created at 0xb40000724a020640 (threading is enabled)
Using ASurfaceTexture
FEngine resolved backend: OpenGL
[Google (Apple)], [Android Emulator OpenGL ES Translator (Apple M3 Max)], [OpenGL ES 3.0 (
Feature level: 1
Active workarounds: 
GL_MAX_TEXTURE_MAX_ANISOTROPY_EXT = 0
GL_MAX_COMBINED_TEXTURE_IMAGE_UNITS = 80
GL_MAX_DRAW_BUFFERS = 8
GL_MAX_RENDERBUFFER_SIZE = 16384
GL_MAX_SAMPLES = 4
GL_MAX_TEXTURE_IMAGE_UNITS = 16
GL_MAX_TRANSFORM_FEEDBACK_SEPARATE_ATTRIBS = 4
GL_MAX_UNIFORM_BLOCK_SIZE = 65536
GL_MAX_UNIFORM_BUFFER_BINDINGS = 80
GL_NUM_PROGRAM_BINARY_FORMATS = 0
GL_UNIFORM_BUFFER_OFFSET_ALIGNMENT = 256
OS version: 34
Backend feature level: 1
FEngine feature level: 1
Extended Configuration supported
config ext path /data/user/0/com.google.android.filament.gltf/files/models/21_KB.glb
Texture Decoder has 1 background threads.
FFilamentAsset constructor true
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
isUsingExtendedAlgo true
Requested linear format but KTX contains a sRGB format. 
Requested linear format but KTX contains a sRGB format. 

Logs when running on Mac (looks similar to android),

FEngine (64 bits) created at 0x14486e400 (threading is enabled)
FEngine resolved backend: Metal
Selected physical device 'Apple M3 Max'
Supported GPU families: 
  MTLGPUFamilyCommon3
  MTLGPUFamilyApple7
  MTLGPUFamilyMac2
Features:
  readWriteTextureSupport: true
Backend feature level: 3
FEngine feature level: 3
Requested linear format but KTX contains a sRGB format. 
Requested linear format but KTX contains a sRGB format. 
Extended Configuration supported
config ext path /Users/balajimurali/Downloads/21_KB_new.glb
Content size 4964 File /Users/balajimurali/Downloads/21_KB_new.glb
Creating asset for file /Users/balajimurali/Downloads/21_KB_new.glb
FFilamentAsset constructor true
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
createPrimitives primitiveCount 1
Output prim Vertices count 108
Output prim Indices count 108
File parsed
Node count 14Texture Decoder has 14 background threads.
isUsingExtendedAlgo true

[mbalajee]

Issue fixed by,
#7917