Saturday, January 13, 2024

World Logic Day 2024

 January 14th is World Logic Day, the perfect day to test how logical a chatbot like ChatGPT is right?

This is the question I asked,

"Each side, including the lid, of a cubic steel box has a surface area of 2500 cm2. Twenty coloured balls are placed in the open box. There are twice as many red balls as blue balls inside the box before the lid is welded shut. What is the probability of removing a red ball from the box?"

What is the logical answer to this question? If you are a human being, the logical answer is 0% because if it is a cube and all the sides (including the lid) have the same surface area then there is no hole on any side to withdraw a ball, so when the lid is welded shut you cannot remove a ball.

What is the answer if you are a chatbot? 

This was ChatGPT's response (no additional comments from me, the chatbot's approach is already hysterically funny)...

"Given that each side, including the lid, has a surface area of 2500 cm², and there are 6 sides in total, the total surface area (SA) is given by:
SA = 6 x side
²

Since SA = 2500 cm², we can set up the equation:

2500 = 6 x side²

Solving for the side length (side):

(side)² = 2500/6

(side)² = 1250/3

(side) = √1250/3

Now that we have the side length, we can find the volume ( V ) of the cubic steel box:

V = (side)3

V = (√1250/3)3

Now, assuming there are twice as many red balls ( R ) as blue balls ( B ), we have   R = 2B .

The probability ( P ) of removing a red ball from the box is given by:

P(Red) = Number of Red Balls/Total Number of Balls

P(Red) = R/(R + B)

Substitute ( R = 2B ) into the equation:

P(Red) = 2B/(2B + B}

P(Red) = 2B/3B

P(Red) = 2/3

Therefore, the probability of removing a red ball from the box is 2/3." 

Logical? 

Maybe not, but it does share some similar characteristics with typical student responses (pre chatbots), that is, 

a) Ignore the question and just start doing some random calculations until you arrive at some kind of answer.

b) Ignore units.

c)  Never, ever, under any circumstances check your answer to see if it makes any sense.

ChatGPT score 0% (which is apparently equal to 2/3).

Tuesday, January 2, 2024

Proving ChatGPT is An Idiot

How intelligent is OpenAI's chatGPT?

Here is the question I asked,
"If my mother had 3 sons and each of my brothers has 2 children, how many cousins do I have? "
 
People, being intelligent and logical, would realize there is no sensible answer since there is not enough information in the question, but chatGPT, being neither intelligent nor logical, replied (with HORRIFIED INTERJECTIONS from yours truly),
"In the scenario you described, you are one of the three sons...."
EXCUSE ME! I am definitively female ... cisgender female (she/her)
"...Each of your brothers has 2 children. Therefore, each of your brothers has 2 children, and since you are one of the sons, you also have 2 children. This means that each of the three sons (including yourself) has 2 children.
So, if you sum up the children of all three sons (including yourself), you have a total of 3 sons * 2 children per son = 6 children...."
YOU SEXIST SO-AND-SO! It's 2024 and women are still invisible in society!
"...These 6 children would be your nieces and nephews...."
WAIT! HOLD ON ... 6 children in the next generation OK'ish, but 2 of them are "mine", therefore I'd have 4 nephews and nieces in total, right? (Or is this your way of acknowledging that I may not be male?).
"... Each of your nieces and nephews is a cousin to each other. Therefore, you have 6 cousins in total."
WHAT? COME AGAIN? Somehow my 2 offspring and my 4 nephews/nieces become my cousins? WHAT? 
 
I know that the "T" in GPT stands for transformer, but transforming my gender, some basic arithmetic, and the lexicology of relationships seems to be taking things a tad too far!

Friday, December 15, 2023

AI and chemistry

 How good are AI generated responses to typical chemistry questions?

No better than the source material used for the answer ... which can include common misconceptions.

One such question is "What is the pH of water?". To a chemist this is a nonsense question (comparable to asking what colour an apple is or what shape a building is) yet it is often asked in school science classrooms around the world. 

I asked ChatGPT "What is the pH of water?" This was the answer ...

The pH of pure water at 25 degrees Celsius (77 degrees Fahrenheit) is considered neutral and is defined as 7. A pH value below 7 indicates acidity, while a pH value above 7 indicates alkalinity. It's important to note that the pH of water can be influenced by dissolved substances, and natural water sources may have varying pH levels due to the presence of minerals and other compounds.

I asked perplexity.ai "What is the pH of water?" This was the answer ...

The pH of water is 7, which is considered neutral. A pH of 7 is neither acidic nor basic. It is important to note that the pH of pure water can change due to the presence of impurities or the absorption of carbon dioxide from the air, which can make it slightly acidic. However, under normal conditions, the pH of pure water is 7, indicating neutrality
2

Surprise, surprise, both answers are inaccurate and riddled with common misconceptions (although, to its credit, perplexity.ai does provide sources, but to its discredit it does not refer to a specific temperature which is critical!). ChatGPT emphasizes "pure water", while perplexity.ai is content with just "water". To a chemist, both terms are the same, "water" is a pure substance. If water has substances dissolved in it it is no longer "water" it is an "aqueous solution". Perplexity.ai's referral to "normal conditions" is baffling, perhaps it refers to standard conditions for aqueous solutions? After these issues, both AIs seem to perpetuate the misconception that acidity, basicity (alkalinity) and neutrality are defined by a pH value. This is not true. They are two entirely different concepts (although both are based on an Arrhenius description of aqueous solutions). pH is a measure of aqueous hydrogen ion concentration, independent of whether the aqueous solution has been designated acidic, basic or neutral. Acidic, basic, neutral are terms to describe a the relative amounts of hydrogen ions and hydroxide ions in an aqueous solution.

So, let's start by talking about the neutrality of "pure water". Pure water is always neutral (regardless of its pH). This is because the concentration of acidic protons in the water, H+(aq) or H3O+(aq), is always equal to the concentration of basic hydroxide ions in the water, OH-(aq), that is [H+(aq)] = [OH-(aq)]

An acidic aqueous solution is one in which the concentration of acidic protons is greater than the concentration of basic hydroxide ions, that is, [H+(aq)] > [OH-(aq)]

A basic aqueous solution is one in which the concentration of acidic protons is less than the concentration of basic hydroxide ions, that is, [H+(aq)] < [OH-(aq)] 

So "pure water" is always neutral, but what is its pH? pH is a measure of the concentration of aqueous hydrogen ions in solution, the greater the concentration of hydrogen ions in aqueous solution, the lower the pH. The concentration of these hydrogen ions is very much dependent on the water temperature. The pH of pure water at 10oC is approximately 7.27 but the water is still described as neutral because [H+(aq)] = [OH-(aq)]. The pH of pure water at 50oC is about 6.63 but the water is still neutral because [H+(aq)] = [OH-(aq)].

 The pH of water at 25oC is approximately 7 and is based, NOT on it being defined this way, but on a calculation of the hydrogen ion concentration of water at this temperature.

So, what happens to pH if other substances are dissolved in water to form aqueous solutions at 25oC? Using an Arrhenius definition of acids and bases (and a pH of 7 which has 1 significant figure but even that digit is uncertain), if an aqueous solution has pH < 7  at 25oC it could be described as acidic, but if the temperature is greater than 25oC the solution may be neutral, it may even be basic, we simply do not have enough information to decide. Similarly, If an aqueous solution has pH > 7  at 25oC it could be described as basic, but if the temperature is less than 25oC it is not a justifiable conclusion.

It is important to note that if there are dissolved "substances", including "impurities", "minerals" or "carbon dioxide", then the "water" is not "pure water", it is an aqueous solution, and the AI discussions are not relevant. Furthermore, some solutes dissolve in water at 25oC and increase its pH  (aqueous solution of sodium hydroxide), some decrease its pH  (aqueous solution of hydrogen chloride), and some may have no effect at all on its pH (aqueous solution of sodium chloride).

There is no simple, correct answer for the question "What is the pH of water?". The question does not contain enough information in order for it to be answered. IF the AIs simply stated that the pH of water at 25oC is approximately 7, that would be a pretty good response, however, by providing additional information in the answer they are repeating, and encouraging, common misconceptions about the nature of "pure water", "pH", "acidity", "basicity" (or "alkalinity") and "neutrality". 

For a discussion on why pure water is always neutral and why its pH varies, see https://www.ausetute.com.au/kw.html

For a discussion on what determines whether an aqueous solution is acidic, basic or neutral, see https://www.ausetute.com.au/abneutral.html

Saturday, May 27, 2023

Excellent Advice for Chemistry Teachers

 The WA 2022 ATAR course examination report for Chemistry offers some excellent advice for all teachers of chemistry,

"Teach general concepts from first principles so that students can apply concepts to unfamiliar situations, not just write everything they know."
If you had shown this to me in 2019, I would have been shocked to think that any chemistry teacher wasn't teaching concepts from first principles, but COVID19 really did fundamentally change the way teachers were forced to teach, and how students were forced to study. "Remote learning" encouraged a return to the "bad-old-days" of rote learning "facts" and "how-to"s as a means to obtaining an end (success in exams). Unfortunately, once these electronic measures had been put in place (rather hurriedly in most cases), nobody seems to want to revisit this hasty construct and replace it with something better. There is a huge opportunity here to begin teaching chemistry as a science, using the scientific method, but no, we continue to teach students how to answer exam questions.
This is not education, it is training. And it is training of the worst kind since the ability to answer exam questions is not very useful in the workforce or in adult life.
Heed the advice, "Teach general concepts from first principles so that students can apply concepts to unfamiliar situations", and bad training becomes great education.

Sunday, January 15, 2023

Making it harder to cheat

Here is the problem: teachers want to engage their students with interesting demonstrations and activities to motivate them to think about  a scientific concept. Students, on the other hand, just need a good mark on the tests and assignments so they can become a doctor, or a lawyer, a cobbler or a candlestick maker, etc.

As the technology available to students to help them answer their assignment questions gets better, teachers need to think about how to structure questions to make students think, rather than just google the answer.

Here is an example of a pretty standard sort of test/assignment question; What properties of aluminium make it suitable for use in cooking pots.  Give a disadvantage of using aluminium for pots.

If you copy and paste that into google, there are 2,090,000 results, and the top of the page will read, "Aluminum is lightweight, cheap and very good at distributing heat. It doesn't retain heat particularly well though, so the temperature will fluctuate as food is added to a hot pan. It's also the softest metal on our list, so it will scratch and dent pretty easily."

Assignment done! No thought required!

So we need to re-structure the question. How about this...

On the planet P42da, the element potsnpanium is used to make large pots in which the P42daians heat soup to above the boiling point of liquid water at 1 atmosphere. What properties of potsnpanium make it suitable for this purpose. Give an example of a safety precaution the P42daians should take when handling potsnpanium pots. Describe a way to reduce this hazard.

Copied and pasted into google this yields 0 results and a heap of useful suggestions:

"

  • Make sure that all words are spelled correctly.
  • Try different keywords.
  • Try more general keywords.
  • Try fewer keywords.

"

Might force some students to have a think about it.

Thursday, January 12, 2023

Corrosion in the Kitchen

 There are two jars of nuts in the kitchen. One jar is always filled with unsalted nuts while the other jar is always filled with salted nuts.

Can you tell which jar holds the salted nuts?


Visit Corrosion Chemistry Tutorial (ausetute.com.au) for more information.

Saturday, December 17, 2022

Cooking vs Chemistry

Chemistry is like cooking ... just don't lick the spoon.

Cooking can be used to help students understand fundamental chemical concepts, like chemical equations and stoichiometry.

Read how at https://www.ausetute.com.au/ausenews/ausenews.html