Atom Learning mastery score not changing

[DibbleDooDah]

Anyone else have an issue with the mastery scores not changing on Atom Learning? My DC has done half an hour every day for the last week and the score hasn’t changed at all. I have tried logging out and logging back in again.

Also, her mastery score says “Good” but if you drill down into the detail, all but two out of thirty four sections are marked “Strong”. Do the two “Good” ones really bring the algorithm score down by so much?

Trying to work out if there are any areas they need to be working on more than others.

We had this issue as well. Scores did not change even after ds got so many correct like 29/30 in a certain section and it said it checks the last 30 in the section to get the scores. I emailed Atom. Eventually the scores went up. But I still feel like there are issues, as some scores have gone down, even though he answers most correct...only ever missing one question but mostly missing none. It is so odd. Def email Atom so they can get to work on fixing any glitches. As the more people that question it, they will realise it is a problem.

I agree it looks like there is a problem but was wondering if it was just us. One of the VR sections (her weakest) hasn’t appeared in a learning journey for a month now. Despite me setting practices in it and her getting them mostly right, the blooming thing just isn’t changing and it’s demotivating her.

Yea, I find it frustrating and have sent emails about it. Def email them so they hopefully sort it out.

@DibbleDooDah any updates on your Atom scores? My ds suddenly went up like 150 points in English and has become strong....he is now above the average atom user by 130....so I am wondering what happened over night. He only did 15 questions last night in the English. It is hard to know if these scores mean anything or not. All I want to know is how is doing so I know if he needs to work at certain areas more, but hard to know if the algorithm is working properly.

We also had a big change in mastery scores overnight. I have copied and pasted their reply below (which basically tells me nothing!!!) but I suspect they had a glitch in the system……

“Thanks for getting in touch - I apologise for any confusion or upset caused by our scoring, and hope to provide some clarity and support below.

When you click 'View Topic' next to Logic on the VR Mastery page, this takes you to the Curriculum page. Currently, the Curriculum page only shows performance in the Learning Journeys, unlike the overall Mastery Scores, which take into account all work completed on the platform. We understand that this could be more valuable if it included Custom Practices and Mock Tests, so have been working hard to update the Curriculum page to reflect all work completed on the platform. You can turn on a preview of this by turning on the 'Atom Level Scores' feature preview. Feature previews are found by clicking the profile icon in the top right of your Parent Portal, then clicking 'My profile', then the feature preview tab. Please note that turning this on will also slightly impact your daughter's progress data as we're changing our scoring slightly too, as explained below.
The current mastery scores are calculated by looking at the last 30 questions answered in each topic and then taking an average across the topics to calculate the overall subject score. In English for example there are 5 topics: Spelling, Vocab, Grammar, Punctuation and Comprehension. This means the overall English score is calculated by taking an average of the last 150 questions, 30 per topic.This means the score can be skewed as the topic score is not calculated by looking at the last 30 questions in each area, just the last 30 questions in the overall topic. For example, within Spelling there are 7 individual skills. If a child answered 15 questions in 2 of these skills, prefixes and suffixes, then this would make up the most recent 30 questions in spelling without taking into account the other areas.
The new update will mean that rather than just looking at the most recent 30 questions across the entire topic the scores will take into account the last 30 questions answered in each skill in each topic. The average across all skills within the topic will then make up the topic score and again the average across all topics will make up the subject score.
If we take the same example of spelling in English this will mean that the topic score for spelling is calculated by looking at the last 30 questions answered in each of the 7 individual skills within spelling: plurals, compound words, prefixes, suffixes, silent letters and letter strings. This means the topic score will be based on the last 210 questions answered, rather than the last 30 questions.

I hope this makes sense and will make things easier for you. Please let me know if you have any questions or require any further assistance.”

@DibbleDooDah thanks. I am still confused lol. Did they fix the glitch and now it reflects the true scores or is there a glitch? It is quite frustrating! We turned that feature on a month ago. I will ask if they are still making updates.

@SamPoodle123 The mastery scores now seem to have totally disappeared and I have a whole new dashboard which actually looks like it will be more useful for working out areas to work on. Assuming they have done an update…….

@DibbleDooDah I see the made some updates, but I still have the mastery scores. It looks the same to me, but they now added master to the level your dc is working at so for example, needs practice, good, strong and master. How does it look different for you? What year is your dc btw? Mine is year 4

I don’t have the numerical values for mastery any more, just the comparison graph thingy vs other students.

My DC is in Y5.

I have the mastery scores today, which have been updated compared to yesterday's. I messaged customer service and was told they update the scores every night using the last 30 questions in each topic.

hmm, mine gives numerical values still. Odd. I wonder why yours changed?

This is what I have. I have extra graphs and each section split into mastery, strong etc but no scores with the unders or overs comparisons as seen previously.

@DibbleDooDah maybe it is because your dc is year 5 and mine is year 4? I put a target school, but it does not say anything in comparison to target school. Does it compare your dc to others applying to your target school? That is interesting information to have if it does!

@SamPoodle123 Yes. You put in the name of the most academic school you are sitting for and then it compares you against all the other children also registered on Atom for the same school.

I had the scores in the afternoon, but they disappear in the evening. Instead, a video popped up saying there is new data available ...
It seems they have been updating the software and there are glitches

Wondering if anyone has had their Mastery Scores reappear with numerical values yet? I haven’t and finding it frustrating.. :(

Nope

@DibbleDooDah @SchoolMama I have the numerical mastery scores back after talking to the customer service.

It seems they have been updating the system and the new dashboard adds new functions and gets rid of some (eg. The curriculum coverage). In the transition period, there are/were some glitches. I saw different mastery levels using different devices/browsers and reported this issue. The customer service dealt with it swiftly and escalated to the technical team.

Yes, me. I sent an email in saying I preferred the old way and voila it returned back. I am not sure it is to stay, but has been like that for several days.

Thanks for the tip SP123 - ideally we would have numerical Mastery score as well as Progress score. The latter seems to have replaced the former..

Thanks skyblueblue!

It does feel a little frustrating with all these glitches and updates.