Python 3.8.5

Hopefully, they'll use this for testing: https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/profiler/profiler_v2_test.py

ModuleNotFoundError: No module named 'tensorflow_text'

Understood. Any ETA on tensorflow_text?

https://github.com/tensorflow/text/issues/538 https://github.com/tensorflow/text/issues/654

I tried the tensorboard profiler in a Keras example. It doesn't work either. https://github.com/tensorflow/tensorboard/blob/master/docs/tensorboard_profiling_keras.ipynb

Here's what was generated. Any idea why the tensor board profile tab empty? % ls -lR train/plugins/profile/2021_08_29_11_07_46  total 232 -rw-r--r--  1 davidlaxer  staff   4867 Aug 29 11:07 BlueDiamond.local.input_pipeline.pb -rw-r--r--  1 davidlaxer  staff      0 Aug 29 11:07 BlueDiamond.local.kernel_stats.pb -rw-r--r--  1 davidlaxer  staff   1501 Aug 29 11:07 BlueDiamond.local.memory_profile.json.gz -rw-r--r--  1 davidlaxer  staff   5938 Aug 29 11:07 BlueDiamond.local.overview_page.pb -rw-r--r--  1 davidlaxer  staff   4013 Aug 29 11:07 BlueDiamond.local.tensorflow_stats.pb -rw-r--r--  1 davidlaxer  staff  14817 Aug 29 11:07 BlueDiamond.local.trace.json.gz -rw-r--r--  1 davidlaxer  staff  74605 Aug 29 11:07 BlueDiamond.local.xplane.pb (base) davidlaxer@x86_64-apple-darwin13 20210829-102538 %

Several of the profiler tools are not functional (e.g. - Kernel Stats: There is no GPU data to display because there were no kernels in the capture duration. tf_data_bottleneck_analysys: No tf.data activitiy captured in your profile. If your job uses tf.data, try to capture a longer profile.

How do I send you a Jupyter notebook?

Also, why doesn't the GPU run when Tensorflow is in Eager Execution mode? In the prior version of 'tensorflow-metal', I had to disable Eager Mode for the GPU to run: tf.compat.v1.enable_v2_behavior() from tensorflow.python.framework.ops import disable_eager_execution disable_eager_execution()

You can find the notebook in the notebook directory in this repository: https://github.com/ddangelov/Top2Vec

I installed MacOS 12.0 Beta and attempted to train the model with tensorflow_macos and tensorflow_metal 2.6. Training the model consumed ~110GB DRAM before I killed the kernel (the iMac has 128GB). I tried reducing the number of input rows in the training set to: 18806 rows × 5 columns, but it still runs out of memory. Also, I can't tell from the Activity monitor whether the GPU is running.

I tried the previous versions of 'tensorflow-macos' and 'tensorflow-metal' and they also had issues: E.g https://developer.apple.com/forums/thread/691339

Did you happen to measure the performance difference between CPU and GPU with the SDG optimizer? Was the CPU 4X faster?

I'm getting some results with the 'Adagrad' optimizer. At epoch 57: Epoch 58/100 6332/6332 [==============================] - 1621s 256ms/step - d_loss: 0.6239 - g_loss: 0.8338 Epoch 59/100 1342/6332 [=====>........................] - ETA: 21:07 - d_loss: 0.6044 - g_loss: 0.8635