Cannot load best_model.keras

[8libra]

Hello, I'm really stumped. I used autokeras to train a text classification model. The best model was saved off in best_model.keras, I can see in tuner.py where the save call is. But I cannot reload the models to use it. Believe me, I have tried a whole bunch of things the whole day and read through everything I can find, and I'm stuck. My training program looks like this.

import numpy as np
import tensorflow as tf
import keras_nlp
import autokeras as ak

clf = ak.TextClassifier(max_trials = max_trials)
clf.fit(x_train, y_train, epochs = training_epochs)

best_model = clf.export_model()

At this point however, I notice a "best_model.keras" file is created automatically (and I can see the call in tuner.py) and this file is bigger than any file I save manually. I decide to use the best_model.keras files saved by autokeras.

All I want to do for the sake of testing is to load the model without errors. And I cannot, after trying as many permutations as I can find.

#! /usr/bin/env python
import tensorflow as tf
import keras_nlp

model_file = "best_model.keras"
m = tf.keras.models.load_model(model_file)

The chief complaint seems to be no vocabulary is passed in. I have tried various permutations of passing in custom_objects, for example loading autokeras and passing in custom_objects = ak.CUSTOM_OBJECTS and that doesn't work either.

autokeras/keras_nlp downloaded the Bert vocabulary file and I do have that file.

I cannot reload the model even in the same Python interactive session where autokeras just trained and saved the model.

So, I have potentially useful "best_model.keras" files that I cannot use, which is sad. I'm terribly stuck, and any feedback would be appreciated.

Alan