No evaluation of brain performance

%3CLINGO-SUB%20id%3D%22lingo-sub-2136008%22%20slang%3D%22en-US%22%3ENo%20evaluation%20of%20brain%20performance%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2136008%22%20slang%3D%22en-US%22%3E%3CP%3EAfter%2075k%20iterations%20and%20124%20episode%20(600%20iteration%20per%20episodes)%2C%20I%20have%20none%20evaluation%20of%20brain%20performance.%20In%20my%20previous%20project%20I%20have%20evaluation%20after%2010k%20or%2030k%20iterations.%20In%20Inklink%20I%20specify%20to%20evaluate%20after%2010%20episodes%3CBR%20%2F%3E%3CBR%20%2F%3E%3C%2FP%3E%3CDIV%3E%3CDIV%3E%3CSPAN%3Ecurriculum%3C%2FSPAN%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3E%7B%3C%2FSPAN%3E%3C%2FDIV%3E%3CDIV%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Etraining%3C%2FSPAN%3E%3CSPAN%3E%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3E%7B%3C%2FSPAN%3E%3C%2FDIV%3E%3CDIV%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3EEpisodeIterationLimit%3C%2FSPAN%3E%3CSPAN%3E%3A%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3E600%3C%2FSPAN%3E%3CSPAN%3E%2C%3C%2FSPAN%3E%3C%2FDIV%3E%3CDIV%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3ELessonAssessmentWindow%3C%2FSPAN%3E%3CSPAN%3E%3A%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3E10%3C%2FSPAN%3E%3CSPAN%3E%2C%3C%2FSPAN%3E%3C%2FDIV%3E%3CDIV%3E%3CSPAN%3E%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3E%7D%3C%2FSPAN%3E%3CSPAN%3E%26nbsp%3B%3CBR%20%2F%3E%3CBR%20%2F%3EFor%20learning%20using%20PPO%20algorithm.%3CBR%20%2F%3EWhat%20can%20be%20wrong%3F%20i%20spend%20too%20much%20money%20for%20this%20project%20already%20and%20have%20no%20results%20at%20all.%3C%2FSPAN%3E%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E
New Contributor

After 75k iterations and 124 episode (600 iteration per episodes), I have none evaluation of brain performance. In my previous project I have evaluation after 10k or 30k iterations. In Inklink I specify to evaluate after 10 episodes

curriculum {
            training {
                    EpisodeIterationLimit600,
                    LessonAssessmentWindow10,
                } 

For learning using PPO algorithm.
What can be wrong? i spend too much money for this project already and have no results at all.
1 Reply

@MichalFEIT2020 PPO makes use of episode batching during training. 124 trajectories provides very little information for the algorithm and is probably not enough for the first training batch. 

 

For more information about batching and how to control the batch parameter, refer to [this documentation](https://docs.microsoft.com/en-us/bonsai/inkling/advanced/algorithm#ppo-parameters).

 

Note that different RL algorithms have different batching behaviors. I suspect that your previous project used one of the other algorithms (probably APEX), which would explain why you're seeing a difference in behavior.