This directory contains results updated in real time from an experiment about the partly supervised learning of representations and concepts.

The code is available on https://fleuret.org/git/culture and a summary of the whole experiment is available as a thread on X.com.

plots.png

accuracy and perplexity plots

w_quizzes/

examples of quizzes from the reference hand-designed tasks.

c_quizzes/

quizzes that have been created by the generative models.

prediction/

prediction on quizzes. Green and red frames indicate what has been predicted and if it is correct.

generation/

generation of quizzes.

other/

other files

20240919-23:04:26 wrote ae_*.pth
20240919-23:04:26 epoch_duration 2min35s next_finish 23:07:01
20240919-23:04:26 wrote state.pth
20240919-23:04:26 --- epoch 148 ----------------------------------------
20240919-23:04:26 current_test_accuracies 0.9290 0.8900 0.9250 0.9300 0.9260 0.9240 0.9310 0.9240 0.9460 0.9140
20240919-23:04:26 no_c_quiz
20240919-23:04:26 weakest_accuracies [0.89, 0.914]
20240919-23:04:26 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20240919-23:04:26 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20240919-23:06:44 train_loss 148 model 1 0.022625757217407227
20240919-23:06:44 quiz_set nb_w_quizzes 1000 nb_c_quizzes 0
20240919-23:06:44 train_loss 148 model 9 0.022970446586608885
20240919-23:06:44 quiz_set nb_w_quizzes 1000 nb_c_quizzes 0
20240919-23:06:45 test_loss 148 model 1 0.019548416137695312
20240919-23:06:45 quiz_set nb_w_quizzes 25 nb_c_quizzes 0
20240919-23:06:45 test_loss 148 model 9 0.019810295104980467
20240919-23:06:45 quiz_set nb_w_quizzes 25 nb_c_quizzes 0
20240919-23:06:46 quiz_set nb_w_quizzes 1000 nb_c_quizzes 0
20240919-23:06:46 quiz_set nb_w_quizzes 1000 nb_c_quizzes 0
20240919-23:06:49 test_accuracy 148 model 9 nb_correct 957 / 1000 (95.70%)
20240919-23:06:49 test_accuracy 148 model 1 nb_correct 949 / 1000 (94.90%)
20240919-23:07:00 wrote ae_*.pth
20240919-23:07:00 epoch_duration 2min34s next_finish 23:09:34
20240919-23:07:00 wrote state.pth
20240919-23:07:00 --- epoch 149 ----------------------------------------
20240919-23:07:00 current_test_accuracies 0.9290 0.9490 0.9250 0.9300 0.9260 0.9240 0.9310 0.9240 0.9460 0.9570
20240919-23:07:00 no_c_quiz
20240919-23:07:00 weakest_accuracies [0.924, 0.924]
20240919-23:07:00 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0
20240919-23:07:00 quiz_set nb_w_quizzes 50000 nb_c_quizzes 0