Best Answer

Are you background jobs running?


Userlevel 7
Badge +7

Since the move to the data lake and the new process of 4hr refreshes, it seems this process is hit and miss...Over the weekend ran some reports and all went fine...today, on 2 separate client site, both reports and other background jobs are completely stalled. Nothing running for hours. Have 2 outstanding tickets…

Question to the Community...anyone else experiencing these serious latency issues with reports and b/g jobs?

icon

Best answer by lrnlab 2 November 2022, 15:03

View original

16 replies

Userlevel 5
Badge +1

I haven’t seen any issues with my reports, but I’ll be watching. Sometimes a data lake fixes take time to propagate properly. 

Userlevel 7
Badge +3

fortunately, have not seen yet *knocks on all the wood*
hope you’re sorted soon!

Userlevel 2
Badge

I’m having latency issues too and I have been contacted by a fellow admin that they have received a “data refresh in progress” message.

Userlevel 7
Badge +3

Are you by chance in the US-East AWS bucket that has been having issues and 500 errors? (or maybe that issue is causing your performance issues?)

Userlevel 7
Badge +7

@Bfarkas we’re in Canada. Apparently the CA-1 server is also having issues but has not been reported on the status page

Userlevel 7
Badge +3

ah, well hopefully the issue they found and resolved here helps there too!

Userlevel 7
Badge +7

pretty sure they are not related as ours, I believe, is about the data lake..all jobs failing since 6:15 AM ET

 

Userlevel 7
Badge +3

aka frozen lake.

Userlevel 7
Badge +7

indeed

Userlevel 7
Badge +5

Seems like it’s about the time of year for lakes to start freezing up.  🙃

I’m definitely noticing latency in my system today, but haven’t encountered any issues with data refresh over here, but definitely keeping an eye on it. 

Userlevel 3

I have notice latency since the move as well.  I have several reports that are run nightly and sent out to various people.  They uses to run anywhere from 12am-4am central.  Now they are not running or being sent out until between 7-9am, sometimes not until mid-morning.  Our Project Managers rely on these to prepare for their calls with customers so it is a little frustrating with the latency and the inconsistent timing. 

Userlevel 7
Badge +3

We’ve had some data refresh issues since the move, but thankfully everything seems to be running okay at the moment. We’re on the AU (Sydney) Region server.

Userlevel 7
Badge +7

Seems the issue was corrected yesterday afternoon after many cries and emails. Thank you to support for ensuring this was resolved as quickly as possible.. Still quite scary that the system can be bricked this hard. After 2 such occurrences within 2 weeks, I certainly hope this is the final fix. Still waiting to know the root cause. 

Userlevel 5
Badge +1

I'll try some reports today. I was seeing some latency issues yesterday. Thx for submitting the tickets! 

Userlevel 1

We haven’t been able to run reports since Monday. The message says: Last update of reports' data: Data Refresh in Progress. We have an open ticket and have been waiting on a resolution. We’re in Texas. 

Userlevel 5
Badge +1

We haven’t been able to run reports since Monday. The message says: Last update of reports' data: Data Refresh in Progress. We have an open ticket and have been waiting on a resolution. We’re in Texas. 

We’re in Massachusetts, and I just ran a custom report. The process took a little longer than usual, but it was done in less than a minute. Hopefully the issues are resolved soon. 

Reply