Questions on Harmony Search

Thanks Mike. Ditto on everything for us too. 

Thanks

Simon 

Agree we need a little more information on the above. Thx

Thanks Alessandro. Yes, enhanced SCORM support was the biggest query from our team of LXDs. 

Big fan of what I’ve seen so far of Harmony, BTW. 

Thanks

Simon

Yes this will really shift us into a place of more informal learning. If learners using ai search are consuming a license we absolutely have to be able to measure the results. Without buying something like DLI ;)

Ciao ​@Alessandro Ortolina,

Thank you for your reply.  Do you know if there are plans to allow the AI chat to return results based on courses users are NOT YET actively enrolled in but do have visibility into the course’s catalog?  To us the current set up of it only including courses I’m enrolled in is limiting.

If I am a user looking for how to do a certain task, I would think the chances I’m not yet enrolled in the course with the answer yet are pretty good.  Using a very simple generic example, if I would like to know how to make lemonade, and I’m already enrolled in the “How to make lemonade” course, I wouldn’t need to use the serach, or maybe I could use it as as a reminder of which course to watch.  What would be more helpful, I think, is for the AI to say “There is a course you have access to but have not yet enrolled in that covers this exact toipc, and it’s called “How to Make Lemonade.”  Does this make sense?  Any plans for allowing this?  Similar to how the keyword search uses Course Catalogs for it’s search universe.  Grazie!

One thing I don’t like about the Harmony search is that you can’t link to search results directly anymore. Those Docebo search URLs no longer work and I think tracking search terms via Google Analytics won’t work now either.

E.g. https://sample.lms.com/learn/global-search/time%20management - the ‘time management’ topic can be linked to directly with the old search, but doesn’t work in the Harmony search.

We’ve linked to search results many times for users to assist them and we also use search results from Google Analytics to provide insights on what to feature in our newsletters and front page. This is a big issue for us with Harmony search.

I’m specifically curious about OP’s item 2.  Can we correct Harmony when it makes mistakes so it will do better next time?  We have seen 2 things happen:

1. Harmony gives a result that is just flat wrong.  We would like to be able to correct this.  For instance maybe you ask Harmony what kind of battery a product uses, and it replies back AAA, when the correct answer is AA.  In the cases we’ve seen this, it’s because Harmony is confusing what the user is asking about.  The user might ask “What battery does PRODUCT A use”, and then Harmony finds and quotes a piece of content about PRODUCT B instead.
2. Harmony quotes a piece of content that isn’t the best, as OP said.  In the battery example, maybe the right answer is referenced in 5 different videos, but Harmony might quote a sales features and benefits video, while in this case an instruction-manual video would be a better choice since the learner is probably asking about how to do maintenance on the product.

I’ve given it a thumbs-down, marked the info as factually incorrect, and replied with the correct answer, but then if I ask Harmony the same question again, I get the same wrong answer.

Hi Martin - I’m curious about what you’ve written...can you explain what you mean by linking to search results for users, and also how you get search results out of Google Analytics?  Thank you!

We do have some directory pages set up that link to all channels, pages, and catalogs in the system, with some linking to search results if we don’t have specific channels or catalogs for those less popular topics.

As for the Google Analytics, this is very helpful for us to see what people are searching for, which is broken with Harmony Search.
 

Ciao ​@mdarem72, and thanks for your feedback. I can confirm that this is an enhancement we are planning to evaluate. What we would like to implement is an option that allows administrators to extend visibility to courses in catalogs accessible to the user, when the user hasn’t enrolled yet. Initially, we are considering applying this only to free courses, as we don’t think it’s appropriate to allow the system to extract information from paid courses that haven’t been purchased.

So, in short, yes, it’s something we are evaluating and would very much like to include as an improvement.

Completely agree. The access to the material must dictate if the information is presented in the answer or not, but an answer that masks the information and invites the learner to Enroll or to buy the course, is perfect. Actually this was the first suggestion I got when I presented Harmony search to our management, for upsale reasons.

Figured I’d add to this thread instead of starting a separate one… curious if anyone has experienced in their instance of the platform the Harmony Search / Chat Responses to be VERY slow in generating? We have only experimented with the preview option so not sure if that impacts it. In general I’ve liked what I’ve seen from what it can generate but when it takes 5 minutes to generate a response to a simple question I think I’ll struggle to get people to leverage it. 

Did you encounter this on a sandbox or a production platform? The reason I ask is because i noticed our sandbox can sometimes be very slow, close to unresponsive; quite rarely, but sometimes it happened. And I can understand that because it’s a sandbox, and I believe the hardware resources are low prioritized for it, or overbooked.

So my point is that it could be from the sandbox environment, not from the Harmony feature.

Nevertheless if it’s a recurring problem, it should be approached with Docebo support.

Thanks Dan, this was in the Sandbox and I wasn’t sure if that was the case… always hesitant to try things or turn things on in Production until we’re more ready to go, will see about activating my preview in Production and testing. Thanks for sharing your experience.

We are also interested in all of the above mentioned in the original post. Thanks!

What type of questions are you making in the Harmony search in preview mode? I don´t get any results, I have tried different questions, but I get your question can't be processed or it just doesn´t show anything. 

Hi ​@mdarem72, and thank you for raising this point, it absolutely makes sense. We are indeed exploring the possibility of adding an option that allows Harmony to include catalog content that’s visible to the user but not yet actively enrolled. The idea is that when a user asks Harmony about a topic, if the content type is supported, Harmony could provide a response along with a link to the relevant course catalog page, so the learner can easily self-enroll.
As soon as we have more detailed information on this new feature, we’ll be sure to share it.