Your personal GPT

Your personal GPT

A few weeks ago I made a short post on ChatGPT where I voiced some caution on its use. I have read more about it and similar large language models (LLMs) since which convinced me that there is no real “I” in the models … yet. It seems they are ‘just’ a different form of statistical analysis, but a powerful one. An article on the possibility of building a local LLM was interesting in that sense as it explained the source text would be split into chunks of maximum 500 words for processing. This does not seem to be the best way to develop an understanding on anything with some complexity, it would certainly not be for a human. Still, with a large enough dataset and computing power it clearly seems to ‘work’.

The possibility of a ‘private’, local GPT does seem interesting however because, rather than querying only open source data (the internet) it could be used to query your / your company’s writing and reports and/or specific reference documents, giving responses based on your interests and ‘experience’ only.

I decided to give this idea a go using the aforementioned article and the PrivateGPT developer’s github site. I am no IT wiz so it took some 3 hours to get it up and running but run it did.

The sample document on the git is a tiny ‘State of the Union’ txt file but I decided to go a bit bigger though (fortunately) refrained from immediately throwing my full local library at it. I used 17 pdf documents (handbooks, port related guides, full list at the bottom for the curious) totalling 238MB that were split into 12,967 chunks of text (max. 500 tokens each) by the ‘ingest’ module resulting in a 33MB database that could be queried. That conversion took roughly half an hour (didn’t really time it) doing other things while keeping an eye on the prompt.

The first query that popped into my mind: “what is the definition of a suezmax”, which I thought would be pretty straightforward and was answered after a few minutes of ‘thought’ (493.65 seconds according to the response. The response typed-up fairly slowly and produced an inconclusive answer in garbled language, unfortunately not quite the ChatGPT or Bard standard. I won’t bore the non-maritime readers with the results here but have added them to the bottom of the page if you are interested.

My question “what is a dolphin” resulted in an answer with slightly better (but still bad) grammar and it was still a poor excuse for an answer though arguably more accurate than the ‘big boys’ as I was referring to the dolphin of a berth, not the marine mammal. My source documentation only ‘knows’ about the former while for the latter these structures are probably such a small subset of the information about dolphins as animals it doesn’t even register. This is actually important I feel. Again, comparative responses below if you are interested.

Does this mean the ‘PrivateGPT’ is useless? Probably not. I can ‘play’ with some of the response parameters in the set-up, have a larger set of source material or a more focussed set. I probably could do with a better/faster computer too. A Private GPT type solution potentially offers the possibility of a ‘set’ of libraries on different subjects that could be queried. It would limit the potential (or risk) of ‘lateral responses’ but could be very useful for question like ‘did we do this before’, ‘do we have a sample of that’, ‘what experience do we have in’ etc.

I intend to keep tinkering with this, partly because I expect my inputs can be improved and the models themselves most certainly will improve too, but largely because I like to have at least a basic understanding of tools and machines I use. One of my main concerns with the public models is that, if they ‘simply’ use the internet as their source, the loudest voices will win. For uncontroversial subjects this is unlikely to be a problem but for controversial ones and niche issues I am far from certain, and this first experiment does not ease my mind.

That someone with the very basic level of programming skills could get something like installed and working on a simple laptop might be another thing to think about.


Question: what is the definition of a suezmax

PrivateGPT:

“A SuezMax vessel has been specifically designed for transiting large vessels (in excess of 50,000 DWT) through narrow or shallow canals. The term was coined by IceVirtualLibrary in its publication "SuezMAX - An Essential Guide to Understanding the Vessel" as a symbol that combines three letters: SUZ-E, MAX and TISK refers to Suezmax vessels used for transiting large shipping containers between Panama Canal and Central America/Caribbean.”

ChatGPT:

“A Suezmax refers to a specific size category of oil tankers that are capable of transiting the Suez Canal. The term "Suezmax" is derived from the Suez Canal, a major shipping route that connects the Mediterranean Sea with the Red Sea, allowing ships to travel between Europe and Asia without circumnavigating the African continent.

A Suezmax tanker is defined by its maximum size constraints, which are determined by the dimensions of the Suez Canal. These tankers typically have a maximum length of around 275 meters (900 feet), a maximum beam (width) of around 48 meters (157 feet), and a draft (the depth of the vessel below the waterline) of approximately 16 meters (52 feet). The maximum deadweight tonnage (DWT), which refers to the total weight of cargo, fuel, crew, and provisions that a ship can carry, for a Suezmax tanker is usually between 120,000 and 200,000 tons.

Suezmax tankers are commonly used for the transportation of crude oil and other petroleum products between the Middle East and Europe, as well as other regions. Their size allows them to carry large volumes of oil efficiently, while still being able to navigate through the Suez Canal.”

Bard:

“A Suezmax is a type of oil tanker that is the largest that can transit the Suez Canal. The term "Suezmax" is derived from the Suez Canal, which is a man-made waterway in Egypt that connects the Mediterranean Sea to the Red Sea. The canal is 193 kilometers (120 miles) long and has a maximum width of 213 meters (700 feet).

The dimensions of a Suezmax tanker are limited by the physical constraints of the Suez Canal. The maximum beam (width) of a Suezmax tanker is 59 meters (194 feet), the maximum draft (depth) is 20.1 meters (66 feet), and the maximum height is 68 meters (223 feet). The maximum deadweight (cargo capacity) of a Suezmax tanker is typically around 160,000 to 200,000 tonnes.

Suezmax tankers are used to transport crude oil and refined petroleum products between the Mediterranean Sea and the Red Sea. They are also used to transport oil between the Persian Gulf and Europe.

Here is a table of the dimensions of a Suezmax tanker: (removed for clarity)

Suezmax tankers are a critical part of the global oil transportation system. They help to ensure that oil can be transported efficiently and safely between different parts of the world.”


Question: what is a dolphin:

PrivateGPT:

“A Dolphin structure, also known as an Energy-absorbing Collapsible Unit (ECU) or Overload iNcident Preventing Device(OIPD),

is designed to provide additional safety by absorbing impacts from ships that berth in the same area. The term ??dolphin?? is a reference to its shape, which resembles an aquatic mammal with sharp teeth and eyes set on either side of its head (hence dolphins). Dolphin structures are typically made out of concrete or steel plate overlaid onto existing dolphin heads but can also be designed into new dolphins from the ground up. The purpose behind adding such devices is to prevent catastrophic accidents in ports where ships may accidentally collide with shore-mounted berthing platforms, like a dock structure for mooring large vessels onshore (see Fig 7). Dolphin structures are considered especially important when few tugboat services exist and weather conditions at port change rapidly from hour to hour.

Delivered by ICEVirtualLibrary.com to: IP 87.213.36.86 On Thu, 01 Sep 2011 08:54:12?Figure 6-7 shows a dolphin structure on the left of an emergency berthing area that is designed and constructed at port facilities with engineering drawings based on detailed design criteria from”

ChatGPT:

“In the context of marine life, a dolphin refers to a highly intelligent and sociable marine mammal that belongs to the family Delphinidae. Dolphins are known for their sleek bodies, streamlined shapes, and remarkable swimming abilities. They are found in oceans and seas worldwide, inhabiting both saltwater and, in some cases, freshwater environments.

Dolphins are known for their distinctive features, including a long snout, known as a rostrum, a curved dorsal fin on their backs, and a powerful tail fluke. They have a highly developed brain, exhibit complex social behaviors, and communicate with each other using a combination of clicks, whistles, and body movements.

These marine mammals are known for their playful and acrobatic behavior, often leaping out of the water, riding waves, and performing flips or spins. They are carnivorous and primarily feed on fish and squid, using echolocation (sound waves) to locate and capture their prey.

Dolphins are highly social creatures and often live in groups called pods, which can vary in size from a few individuals to several hundred members, depending on the species. They engage in cooperative hunting, communication, and other social interactions within their pods.

Dolphins have captivated human interest and are often featured in various forms of entertainment, such as marine parks and aquariums. They have also been the subject of scientific research due to their intelligence, communication abilities, and their potential to provide insights into marine ecosystems and behavior.”

Bard:

“A dolphin is a marine mammal within the infraorder Cetacea. Dolphin species belong to the families Delphinidae (the oceanic dolphins), Platanistidae (the Indian river dolphins), Iniidae (the New World river dolphins), Pontoporiidae (the brackish dolphins), and the extinct Lipotidae (baiji or Chinese river dolphin). There are 40 extant species named as dolphins.

In common usage the term 'whale' is used only for the larger cetacean species, while the smaller ones with a beaked or longer nose are considered 'dolphins'. The name 'dolphin' is used casually as a synonym for bottlenose dolphin, the most common and familiar species of dolphin.

Dolphins are social animals that live in pods of up to a few dozen individuals. They are intelligent creatures that have been known to use tools, cooperate with each other, and even teach their young. Dolphins are also very playful animals and often engage in activities such as surfing, jumping, and spinning.

Dolphins are carnivores and their diet consists primarily of fish, squid, and other marine animals. They use their echolocation to find prey and hunt in groups. Dolphins are fast swimmers and can reach speeds of up to 30 miles per hour.

Dolphins are found in all oceans of the world and in some freshwater rivers and lakes. They are an important part of the marine ecosystem and play a role in controlling fish populations. Dolphins are also popular tourist attractions and can be seen on whale watching tours around the world.

Here are some interesting facts about dolphins:

  • Dolphins are the second-smartest animals on Earth, after humans.
  • Dolphins can use echolocation to create a mental map of their surroundings.
  • Dolphins can communicate with each other using a variety of sounds, including whistles, clicks, and squeaks.
  • Dolphins have been known to engage in altruistic behavior, such as helping injured dolphins.
  • Dolphins are an important part of the marine ecosystem and play a role in controlling fish populations.

Dolphins are fascinating creatures that are still being studied by scientists. They are intelligent, social, and playful animals that play an important role in the marine ecosystem.”


Source documents are all marine related but clearly a bit of a mishmash with respect to topic.

·??????CINS Incident Report for October 2022.pdf

·??????CSAR-101A_Lithium-Ion-Batteries-Guidelines-24-March-2023.pdf

·??????Design of Marine Facilities for the Berthing, Mooring, and Repair of Vessels by Gaythwaite, John W. (z-lib.org).pdf

·??????DNVGL-RU-SHIP Pt.3 Ch.10.pdf

·??????Incom 119 Inventory of inspection and repair techniques of navigation structures.pdf

·??????WG-199 HEALTH MONITORING OF PORT AND WATERWAYS STRUCTURES.pdf

·??????MARCOM 162 Recommendations for Increased Durability and Service Life of New Marine Concrete Infrastructure.pdf

·??????MarCom-WG-145-BERTHING VELOCITY ANALYSIS OF SEAGOING VESSELS OVER 30000 DWT.pdf

·??????MarCom-WG-212.pdf

·??????MarCom-WG-235 SHIP DIMENSIONS AND DATA FOR DESIGN OF MARINE INFRASTRUCTURE.pdf

·??????PIANC_GUIDELINES FOR SITE SELECTION AND MASTERPLANNING MarCom-WG-185.pdf

·??????PIANC_Masterplans for the Development of Existing Ports MarCom WG 158.pdf

·??????Port Designers HandbookThoresen.pdf

·??????Tumby-Bay-Jetty-Condition-Report-Jetty-Storm-Damage (WSCAM example).pdf

·??????Victorian-Boating-Facility-Maintenance-Guidelines.pdf

·??????WG-178_CLIMATE CHANGE ADAPTATION PLANNING FOR PORTS AND INLAND WATERWAYS.pdf

·??????WSCAM High Res.pdf

Interesting trial and suggestion Jeroen. Guess a local engine would indeed allow digesting (often confidential) internal datasets. For niche markets like the ones we operate in this should yield much better results, leaving out proza on marine mammals and focusing on the core context quickly and efficiently.

要查看或添加评论,请登录

Jeroen Overbeek的更多文章

  • All Knowing Anonymity

    All Knowing Anonymity

    Slowjamastan is one of the newest micronations around. Ruled by a dictator Sultan who wants to know everything about…

    2 条评论
  • Form over function

    Form over function

    The company was a mid-sized one with a few thousand people across the globe providing professional services to a range…

  • Only an expert

    Only an expert

    If you don’t feel well, not quite sure wat is wrong with you, or if you feel you need a general check-up; do you go to…

    4 条评论
  • Hidden Hops

    Hidden Hops

    Not in beer, on your CV. A lot of ink has been spilled in the recent past on the ‘big resignation’ with new discussions…

    1 条评论
  • Cracking up

    Cracking up

    Being stuck at home has given me some time to (finally) make progress in learning Python and tinkering around with…

  • The truth is out there

    The truth is out there

    About 71% of the earth’s surface is covered in water according to the USGS and while humanity is working hard to…

    2 条评论
  • Copy, but don't paste (Lesson learnt 2)

    Copy, but don't paste (Lesson learnt 2)

    This is me, 1992, all outfitted for my site visit. How many safety breaches can you spot? I am sure I was perfectly…

  • Sunk Effort - (Lesson learnt 1)

    Sunk Effort - (Lesson learnt 1)

    In behavioural science there is the “sunk cost fallacy” which has people throw good money after bad because of the…

    10 条评论
  • Culture Clash

    Culture Clash

    Have you ever had a coffee or a beer with a client where he grumbled about your team’s performance only to get a great…

    2 条评论
  • (Non) Identical Twins

    (Non) Identical Twins

    People generally like models. Toys are models of the real thing, or of what we would like to be real.

社区洞察