[UPDATED] Docebo Data Lake 2.5: Automated data refresh update

  • 20 September 2022
  • 51 replies
  • 4260 views


Show first post

51 replies

Hi there, I’m not sure if this new update is working correctly for me.

I updated some of our user data around 9:42am, and exported a report at 9:58am, and none of the data had been updated. The last time I ran the report was yesterday at 2pm.

There is a notice that says my data is up to date as of 9am - is this what the “the refresh does not take real time data, but the more fresh data available, that usually are between 1 and 2 hours old” condition refers to? Does this mean if we make updates to information, we can’t expect to seem them in reporting for another 4 hours?

Userlevel 4
Badge

Hi @ayesha.ahmad 

the behaviour you report is the actual correct behaviour of the new data refresh. 

When a data refresh is triggered by an export request, the system takes the more fresh data available, that are not in real time, but as mentioned are usually 1 or 2 hours old. 

That means that to find the updates into a report you have

  • to run a report at least after 2 hours
  • that report must trigger the data refresh

 

Userlevel 7
Badge +6

@nicolo malinverno - thank you for all of the detail - how does this impact My Team reports?

 

Userlevel 7
Badge +6

We have been experiencing intermittent failures of the scheduled reports more and more. Any advice along these lines?

Userlevel 7
Badge

We have been experiencing intermittent failures of the scheduled reports more and more. Any advice along these lines?

@dklinger I’ll follow up with @nicolo malinverno first thing on Monday to see if he has any insight. Thanks for your patience!

Can anyone run reports today?  We have created several tickets and have reached out via chat.  The response has been to wait until 12/21 to run reports.  This isn’t a solution for us.  Have any of you found any workarounds to get data out to your stakeholders?

Userlevel 1

Can anyone run reports today?  We have created several tickets and have reached out via chat.  The response has been to wait until 12/21 to run reports.  This isn’t a solution for us.  Have any of you found any workarounds to get data out to your stakeholders?

 

I can’t run reports today either. 

Userlevel 1

Can anyone run reports today?  We have created several tickets and have reached out via chat.  The response has been to wait until 12/21 to run reports.  This isn’t a solution for us.  Have any of you found any workarounds to get data out to your stakeholders?

I cannot run any, either.

Userlevel 2
Badge

Haven’t been able to get our scheduled reports since Friday. We opened a ticket just now and then I saw this thread after looking for known issues.

 

Userlevel 5
Badge

Is this update complete? We have yet to see changes to our system (regarding the New Reports interface) yet our system (according to info above) was supposed to be done in November.

Any updates?

Thank you

Edit to share with others, I confirmed we can still run reports but it does not yet appear we are on the new solution.

Userlevel 7
Badge

Is this update complete? We have yet to see changes to our system (regarding the New Reports interface) yet our system (according to info above) was supposed to be done in November.

Any updates?

Thank you

Edit to share with others, I confirmed we can still run reports but it does not yet appear we are on the new solution.

@dwilburn we recently published an update to this post indicating that any missing platforms will be activated by mid-January.

Userlevel 7
Badge +6

I feel like I just stumbled into something.

Have we lost the capability for people to receive reports without logging in with this rollout?

A few moments later….please dont mind me - I found what I was looking for.

Userlevel 4
Badge +1

Hello @nicolo malinverno,

I´m confusing about the report data refresh.

You said in the posts above:

“1 -  Data refreshes can happen up to 12 times a day.”

“ 2 - |The data refresh is run automatically when you export a report (and the data are older than 4 hours) 

“ 3 - the refresh does not take real time data, but the more fresh data available, that usually are between 1 and 2 hours old. “

So, If the data refreshes run At 10 a.m ( item 1),

And I generated a report at 11 a.m , and automatically  refresh the data ( item 2)

The report will be generated with the 10 a.m updated. Every change between 10 a.m to 11 am will not reflected in the report. 

Is my understanding correct?

Is it possible to reduce the data report refresh  to 4 hours for 2 hours? 

During the business day, we have only two times to process a data report refresh. Wee need more.

Thank you.

Userlevel 3

Hi @erin.brisson  @nicolo malinverno 
Wanted to get more clarity on the 3 main rules you posted. I am a little confused about point 2 and 3. They read like they contradict each other. Can you please explain them with an example and timings?   

Point 3 refers to data between 1-2 hours old but point 2 says it must be older than 4 hours? It’s a little confusing.


Keep in mind 3 main rules:

  1. to update the data is needed a report export request
  2. the data are updated only when they are older than 4 hours
  3. the refresh does not take real time data, but the more fresh data available, that usually are between 1 and 2 hours old.
     

Thank you 

Userlevel 5
Badge

@nicolo malinverno Confirming this was rolled out to all platforms in January 2023?  I still see a note that US regions were delayed.  Perhaps an update to the update if all regions are now aligned? Thanks! 

Userlevel 4
Badge +1

This process is very confusing.

Today I discovered through Help Desk, that there is a configuration to inform how many hours the reports will be updated: Advanced Settings> Advanced Section. But I didn't find this option on my platform. See below.

 

 

Userlevel 3

This process is very confusing.

Today I discovered through Help Desk, that there is a configuration to inform how many hours the reports will be updated: Advanced Settings> Advanced Section. But I didn't find this option on my platform. See below.

 

 

I don’t see this option in my platform either!

Userlevel 4
Badge +1

I opened a ticket about this. As soon as I have an answer, I'll post it here.

Userlevel 5
Badge

I opened a ticket about this. As soon as I have an answer, I'll post it here.

I think that is the functionality they took away...the automatic refresh.  It’s supposed to refresh data in the data lake now if the data is more than 4 hours old...but the refresh apparently is pulling data that could be up to 2 hours old as the “refresh”  This “upgrade” doesn’t seem to be an upgrade… All the documentation says “real time” update...but then contradicts that with this caveat about the refresh data being up to 2 hours old with the refresh is pushed to the data lake.  It’s extremely confusing.  

Userlevel 4
Badge +1

Hi @hwolfehall , I  agree with you, very confusing. I had an understanding that there are two processes. One is the data lake update and the other is reporting data update.
Because of it , if a learner completes a course, and we update the report data, this information is not updated

Let's see if we can get an answer on how the process works.

Userlevel 4
Badge +1

Hello,

The Docebo Help desk set my platform to update the data refresh in 2 h. I still do not have access this configuration, but it´s work.

I generated a report at 14h, and 16:10h the data will be updated again. See below:

 

 

 

 

 

Userlevel 5
Badge

Hello,

The Docebo Help desk set my platform to update the data refresh in 2 h. I still do not have access this configuration, but it´s work.

I generated a report at 14h, and 16:10h the data will be updated again. See below:

 

 

 

 

 

Thank you!  I have asked for an interval change via Support Ticket.  Fingers crossed.  :)  

Userlevel 4
Badge

Hi @msantos 

your description 

The report will be generated with the 10 a.m updated. Every change between 10 a.m to 11 am will not reflected in the report. 

is correct. 

we know that the current data refresh procedure is complex, but as you have seen, in particular condition we can achieve the refresh within 2 hours and we have to think about this as part of our commitment to improve the data refresh frequency and we have to see it as a step through a even more frequent (and less complex) process. 

For a detail description of the behaviour please check our knowledge base article and let me know it that description is clear enough. 

 

 

 

Userlevel 4
Badge

hi @hwolfehall 

I confirm that the feature is in general availability, and so available for everybody, unless different specific agreement. 

If you are facing troubles you can reach out our support. 

Userlevel 4
Badge +1

Hi @nicolo malinverno , thank you for your explanation.

The article informed “ A snapshot of the live-platform data is updated in the Docebo Datalake on average every four hours”

 

And in the the figure below, “every 1-2 hours”

 

What´s the correct information?

 

 

 

 

 

 

 

 

Reply