Skip to main content

[UPDATED] Docebo Data Lake 2.5: Automated data refresh update


Did this post help you find an answer to your question?
Show first post

51 replies

Hi there, I’m not sure if this new update is working correctly for me.

I updated some of our user data around 9:42am, and exported a report at 9:58am, and none of the data had been updated. The last time I ran the report was yesterday at 2pm.

There is a notice that says my data is up to date as of 9am - is this what the “the refresh does not take real time data, but the more fresh data available, that usually are between 1 and 2 hours old” condition refers to? Does this mean if we make updates to information, we can’t expect to seem them in reporting for another 4 hours?


Forum|alt.badge.img

Hi @ayesha.ahmad 

the behaviour you report is the actual correct behaviour of the new data refresh. 

When a data refresh is triggered by an export request, the system takes the more fresh data available, that are not in real time, but as mentioned are usually 1 or 2 hours old. 

That means that to find the updates into a report you have

  • to run a report at least after 2 hours
  • that report must trigger the data refresh

 


dklinger
Hero III
Forum|alt.badge.img+8
  • Hero III
  • 1652 replies
  • November 11, 2022

@nicolo malinverno - thank you for all of the detail - how does this impact My Team reports?

 


dklinger
Hero III
Forum|alt.badge.img+8
  • Hero III
  • 1652 replies
  • December 9, 2022

We have been experiencing intermittent failures of the scheduled reports more and more. Any advice along these lines?


erin.brisson
Docebian
Forum|alt.badge.img+2
  • Docebian
  • 2851 replies
  • December 9, 2022
dklinger wrote:

We have been experiencing intermittent failures of the scheduled reports more and more. Any advice along these lines?

@dklinger I’ll follow up with @nicolo malinverno first thing on Monday to see if he has any insight. Thanks for your patience!


lbacko
  • Newcomer
  • 1 reply
  • December 12, 2022

Can anyone run reports today?  We have created several tickets and have reached out via chat.  The response has been to wait until 12/21 to run reports.  This isn’t a solution for us.  Have any of you found any workarounds to get data out to your stakeholders?


michelleoonk
Novice III
  • Novice III
  • 8 replies
  • December 12, 2022
lbacko wrote:

Can anyone run reports today?  We have created several tickets and have reached out via chat.  The response has been to wait until 12/21 to run reports.  This isn’t a solution for us.  Have any of you found any workarounds to get data out to your stakeholders?

 

I can’t run reports today either. 


FredTacon
Novice II
  • Novice II
  • 6 replies
  • December 12, 2022
lbacko wrote:

Can anyone run reports today?  We have created several tickets and have reached out via chat.  The response has been to wait until 12/21 to run reports.  This isn’t a solution for us.  Have any of you found any workarounds to get data out to your stakeholders?

I cannot run any, either.


Forum|alt.badge.img
  • Contributor III
  • 44 replies
  • December 12, 2022

Haven’t been able to get our scheduled reports since Friday. We opened a ticket just now and then I saw this thread after looking for known issues.

 


dwilburn
Guide III
Forum|alt.badge.img+3
  • Guide III
  • 306 replies
  • December 12, 2022

Is this update complete? We have yet to see changes to our system (regarding the New Reports interface) yet our system (according to info above) was supposed to be done in November.

Any updates?

Thank you

Edit to share with others, I confirmed we can still run reports but it does not yet appear we are on the new solution.


erin.brisson
Docebian
Forum|alt.badge.img+2
  • Docebian
  • 2851 replies
  • December 23, 2022
dwilburn wrote:

Is this update complete? We have yet to see changes to our system (regarding the New Reports interface) yet our system (according to info above) was supposed to be done in November.

Any updates?

Thank you

Edit to share with others, I confirmed we can still run reports but it does not yet appear we are on the new solution.

@dwilburn we recently published an update to this post indicating that any missing platforms will be activated by mid-January.


dklinger
Hero III
Forum|alt.badge.img+8
  • Hero III
  • 1652 replies
  • January 19, 2023

I feel like I just stumbled into something.

Have we lost the capability for people to receive reports without logging in with this rollout?

A few moments later….please dont mind me - I found what I was looking for.


msantos
Helper II
Forum|alt.badge.img+2
  • Helper II
  • 104 replies
  • February 1, 2023

Hello @nicolo malinverno,

I´m confusing about the report data refresh.

You said in the posts above:

“1 -  Data refreshes can happen up to 12 times a day.”

“ 2 - |The data refresh is run automatically when you export a report (and the data are older than 4 hours) 

“ 3 - the refresh does not take real time data, but the more fresh data available, that usually are between 1 and 2 hours old. “

So, If the data refreshes run At 10 a.m ( item 1),

And I generated a report at 11 a.m , and automatically  refresh the data ( item 2)

The report will be generated with the 10 a.m updated. Every change between 10 a.m to 11 am will not reflected in the report. 

Is my understanding correct?

Is it possible to reduce the data report refresh  to 4 hours for 2 hours? 

During the business day, we have only two times to process a data report refresh. Wee need more.

Thank you.


  • Influencer I
  • 60 replies
  • March 1, 2023

Hi @erin.brisson  @nicolo malinverno 
Wanted to get more clarity on the 3 main rules you posted. I am a little confused about point 2 and 3. They read like they contradict each other. Can you please explain them with an example and timings?   

Point 3 refers to data between 1-2 hours old but point 2 says it must be older than 4 hours? It’s a little confusing.


Keep in mind 3 main rules:

  1. to update the data is needed a report export request
  2. the data are updated only when they are older than 4 hours
  3. the refresh does not take real time data, but the more fresh data available, that usually are between 1 and 2 hours old.
     

Thank you 


hwolfehall
Helper I
Forum|alt.badge.img+1
  • Helper I
  • 223 replies
  • March 8, 2023

@nicolo malinverno Confirming this was rolled out to all platforms in January 2023?  I still see a note that US regions were delayed.  Perhaps an update to the update if all regions are now aligned? Thanks! 


msantos
Helper II
Forum|alt.badge.img+2
  • Helper II
  • 104 replies
  • March 8, 2023

This process is very confusing.

Today I discovered through Help Desk, that there is a configuration to inform how many hours the reports will be updated: Advanced Settings> Advanced Section. But I didn't find this option on my platform. See below.

 

 


  • Influencer I
  • 60 replies
  • March 8, 2023
msantos wrote:

This process is very confusing.

Today I discovered through Help Desk, that there is a configuration to inform how many hours the reports will be updated: Advanced Settings> Advanced Section. But I didn't find this option on my platform. See below.

 

 

I don’t see this option in my platform either!


msantos
Helper II
Forum|alt.badge.img+2
  • Helper II
  • 104 replies
  • March 9, 2023

I opened a ticket about this. As soon as I have an answer, I'll post it here.


hwolfehall
Helper I
Forum|alt.badge.img+1
  • Helper I
  • 223 replies
  • March 9, 2023
msantos wrote:

I opened a ticket about this. As soon as I have an answer, I'll post it here.

I think that is the functionality they took away...the automatic refresh.  It’s supposed to refresh data in the data lake now if the data is more than 4 hours old...but the refresh apparently is pulling data that could be up to 2 hours old as the “refresh”  This “upgrade” doesn’t seem to be an upgrade… All the documentation says “real time” update...but then contradicts that with this caveat about the refresh data being up to 2 hours old with the refresh is pushed to the data lake.  It’s extremely confusing.  


msantos
Helper II
Forum|alt.badge.img+2
  • Helper II
  • 104 replies
  • March 9, 2023

Hi @hwolfehall , I  agree with you, very confusing. I had an understanding that there are two processes. One is the data lake update and the other is reporting data update.
Because of it , if a learner completes a course, and we update the report data, this information is not updated

Let's see if we can get an answer on how the process works.


msantos
Helper II
Forum|alt.badge.img+2
  • Helper II
  • 104 replies
  • March 9, 2023

Hello,

The Docebo Help desk set my platform to update the data refresh in 2 h. I still do not have access this configuration, but it´s work.

I generated a report at 14h, and 16:10h the data will be updated again. See below:

 

 

 

 

 


hwolfehall
Helper I
Forum|alt.badge.img+1
  • Helper I
  • 223 replies
  • March 9, 2023
msantos wrote:

Hello,

The Docebo Help desk set my platform to update the data refresh in 2 h. I still do not have access this configuration, but it´s work.

I generated a report at 14h, and 16:10h the data will be updated again. See below:

 

 

 

 

 

Thank you!  I have asked for an interval change via Support Ticket.  Fingers crossed.  :)  


Forum|alt.badge.img

Hi @msantos 

your description 

The report will be generated with the 10 a.m updated. Every change between 10 a.m to 11 am will not reflected in the report. 

is correct. 

we know that the current data refresh procedure is complex, but as you have seen, in particular condition we can achieve the refresh within 2 hours and we have to think about this as part of our commitment to improve the data refresh frequency and we have to see it as a step through a even more frequent (and less complex) process. 

For a detail description of the behaviour please check our knowledge base article and let me know it that description is clear enough. 

 

 

 


Forum|alt.badge.img

hi @hwolfehall 

I confirm that the feature is in general availability, and so available for everybody, unless different specific agreement. 

If you are facing troubles you can reach out our support. 


msantos
Helper II
Forum|alt.badge.img+2
  • Helper II
  • 104 replies
  • March 13, 2023

Hi @nicolo malinverno , thank you for your explanation.

The article informed “ A snapshot of the live-platform data is updated in the Docebo Datalake on average every four hours”

 

And in the the figure below, “every 1-2 hours”

 

What´s the correct information?

 

 

 

 

 

 

 

 


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings