Harmony Search Not Identifying Non Platform Information.

This super important for our use case.  The harmony search seems like a potentially excellent tool for learners to quickly find answers, but in the context of our learning environment, we ONLY want to be presenting the learner with information that comes from within the platform.  Having search results sourced from outside the platform potentially undermines the way we are presenting information to the learner.  And it’s even worse if the information is not clearly marked as coming from outside the platform; the learner will not even know they are getting potentially un-vetted information that the LMS owner does not stand behind.

The most “clear” indication I’ve seen is the second sentence in the disclaimer below the chat text entry, and that statement is static (it’s always there).

That statement is clear, but in my testing, the Harmony search makes no indication at all about what it’s presenting that came from the platform, vs. what it’s presenting that it’s just finding from general knowledge out in the world.  ​@rpannebaker’s post shows that Harmony search claims:

 “I will clearly state that the response is based on general knowledge and not the platform's content.”

But at least as of now, it’s definitely not doing that.  It’s showing general knowledge gleaned from outside the platform, and not putting any kind of label on it at all to let learners know.  For instance, I asked it the following question, and I can 100% attest that there is zero content at all about baseball on our platform, so Harmony MUST have gotten this answer from outside the platform, but it makes no indication that it did so.  I asked it a follow-up question and it essentially admitted it has outdated knowledge from the internet.  In this case, the answer is correct, so it’s harmless, but what it if prevailing knowledge on the internet is wrong, and Harmony presents an answer that conflicts with what we’re trying to teach our learners?
 

That statement is clear, but in my testing, the harmony search makes no indication at all about what it’s presenting that came from the platform, vs. what it’s presenting that it’s just finding from general knowledge out in the world.  ​@rpannebaker’s post shows that Harmony search claims:

 

 “I will clearly state that the response is based on general knowledge and not the platform's content.”

 

But at least as of now, it’s definitely not doing that.  It’s showing general knowledge gleaned from outside the platform, and not putting any kind of label on it at all to let learners know.  For instance, I asked it the following question, and I can 100% attest that there is zero content at all about baseball on our platform, so Harmony MUST have gotten this answer from outside the platform, but it makes no indication that it did so.  In this case, the answer is correct, so it’s harmless, but what it if prevailing knowledge on the internet is wrong, and Harmony presents an answer that conflicts with what we’re trying to teach our learners?
 

 

I understand and agree with you. The point of my comment was not that the statement is sufficient, but that, to the OP’s original point, I haven’t experienced the behavior that he is expecting.

Maybe since it’s still in test mode the “I will cite my sources” feature isn’t fully activated.  It’s understandable to think there will be some rough edges and upcoming improvements, so no problem there and I’m glad we get the opportunity to test it before choosing to turn it on for learners.  For our needs, i think it would be ideal if superadmins could choose between different modes for the search to use:

1. “Super-safe” mode where it only uses information it finds within the platform.
2. “Semi-safe” mode where it prioritizes platform information, but may supplement that with general knowledge, but always with a clear citation of what is from the outside.
3. “Wild West” mode where it finds whatever it can and presents it with no citations.

That’s a great way to approach it. You should submit it as an idea. Let me know if you do. I’d gladly upvote it.