DaiGurenMK42

I think Sarah can make this with dinosaurs and it would be epic. Maybe dinosaurs representing different departments.

Internally this is a living document, and may change as we move forward, but as part of our push for further transparency, we are publishing it in its current form to help our community better-understand how we classify errors and what action we will be taking to rectify them.
 
Types of errors
Flubs: the host simply misspoke
Incongruencies: information within the video is not in agreement (e.g. host says “$45” while the product page shows “$47”
Bad spec: a table or MOGRT contains incorrect information (e.g. “48MB” instead of “96MB”
Bad data: a graph or visualization contains data (generated by us) that is erroneous, misplaced, or spurious. 
Bad info: a statement or representation in the video that is misleading or factually inaccurate
Types of error correction
Proactive (before the video is posted)
Video pickup: the segment is re-shot with both audio and video
Human audio pickup: new audio is recorded for the segment (visuals have coverage)
AI audio pickup: new voiceover is generated. In the best case this uses a voice model that sounds like the host. However, using a robot voice  can still work.
Text on screen: the editor overlays clarifying or correcting text
This will not be received by viewers who are not (or cannot) watching the screen
Reactive (after the video is posted)
Video Replace: replacing the video with a new version without re-uploading
This relies on YouTube and takes some time. There are fairly strict guidelines around the use of this tool and strong justification must be provided for all changes. This is preferred to a re-upload, but there is likely a soft-limit on how often we can use this resource.
Re-upload the video: Set the original, erroneous video to Private and upload a new version. This will have algorithmic effects, but must be done if replacement is not an option
Pinned comment: add a comment describing the correction. 
This will not be received by viewers who do not check the comments (common, especially for those watching on a Smart TV) and should only be used for low-severity errors.
 
Assessing & Responding to Errors
If any of the following types of errors are discovered prior to filming (e.g. during script review) , fix them before the shoot.
 
1. Very Low Severity
- The statement could possibly be misunderstood, but it’s generally true and most people would be fine with how it’s currently presented.
- eg. The host says, “One of DisplayPort’s main advantages over HDMI is its higher bandwidth,” but this is only true when comparing certain generations of the standards. HDMI 2.1, for example, has much higher bandwidth than DP 1.1.
 
Action: no action
 
2. Low Severity
- The statement is incorrect, and we should try to clarify it better in the future, but we can leave it for now because it doesn’t meaningfully impact a viewer’s purchase decision or general knowledge.
- eg. The host says, “This monitor features moderate pixel response times and contrast because it uses an IPS panel”, but the panel manufacturer is actually AUO, rather than LG, so it’s not an IPS panel - a term which is trademarked by LG - but rather an IPS-type or IPS-like panel.
 
Action: Pinned comment
Note: Pinned comment text must be approved by the Community Coordinator before being posted.
 
3. Medium Severity
- The statement is incorrect, and a minority of the audience could be upset or misled, even if it doesn’t really affect the outcome of the product evaluation for the majority.
- eg. The host says, “This GPU has AMD’s AMF video encoder, which is basically the same as NVIDIA’s NVENC,” but while the stated functionality is the same, NVENC offers better image quality, which could be important to a small minority of buyers.
 
Action: Video replaced if possible according to YouTube policy, otherwise pinned comment and above fold mention of the issue in the video description
If doing a video replace, a pinned comment should communicate this is coming and note the expected changes. This comment should be un-pinned when the video replace is complete. 
Note: Pinned comment text must be approved by the Community Coordinator before being posted.
 
4. High Severity
- The statement is incorrect, and a significant portion of the audience could be misled or make a poorly-informed purchase decision.
- eg. The host says, “This is a great gaming monitor,” when in fact, the monitor is a 60Hz VA display that, while ‘fine’ for playing games, lacks important gaming-centric features that could be easily had for the same price, making it a poor choice. 
 
Action: Video replaced if possible according to YouTube policy. Otherwise, set unlisted and disable monetization until corrective action can be taken. 
If doing a video replace, a pinned comment should communicate this is coming and note the expected changes. This comment should be un-pinned when the video replace is complete. 
Note: Pinned comment text must be approved by the Community Coordinator before being posted.
 
5. Very High Severity
- The statement is VERY incorrect—basically the opposite of correct. There is no charitable interpretation that could make this anything but completely irresponsible.
- ex. The host says, “Most games require only one high-performance core to perform their best,” when that hasn’t been true for over a decade.
 
Action: Video removed or remade

As promised, here is the thread where you can post your transparency suggestions for Labs. Here are some examples of things we'd like to see feedback about:
Ideas in our benchmarking. What you'd like to see regarding test system information. Benchmark details. Testbed variations. And, of course, any other transparency-related feedback is welcome, but similar to the Sponsor Complaints subforum, any off-topic comments will be subject to moderation.
 
Thank you for wanting to help us improve the way we do things here!

After thoroughly reviewing each LTT video containing Labs data or analysis, we have arrived at the following results.
Of the 32 videos reviewed, 25 contained Labs Test Data.   Of these 25 reviews, Labs has determined that in the T1 category, (2) videos should be removed until we can verify the results with a second test system.  We also determined that (2) videos contained charts that should be completely replaced after verification of the test results.  In the T2 category, Labs verified that the data is correct, but we have 24 corrections to make to 21 graphs that contain process errors on the charts.  Process errors included transposed numbers, numbers rounded incorrectly, incorrectly labelled tests/components and cross entry into the wrong charts.  These errors are being addressed with continuous process changes, including Labs taking over all charting responsibilities and hiring specialized personnel. We have noticed a significant drop in errors discovered and/or released over the past few weeks.  In the T3 category, we discovered eight typos that included reversed label descriptions and/or incorrect information like the number of PCIe lanes in a spec chart.  While these are pinned comments, we are working on correcting the videos for now.  As discussed in the video today, this post or workbook will not be updated. 

As part of our transparency commitment to the community, we will upload our test procedures for both hardware and software-related items in this thread.  We are starting this process today (See the first reply to this post).
 
Our initial uploads will be in our Bookstack format and then we'll be converting to a version-controlled document for improved auditing and tracking purposes.  We expect to have the vast majority of processes uploaded in September.  And we will continue to provide uploads as we add new test processes and/or modify current processes.
 
Here are links to our testing repositories:
Test harnesses used in LTT Labs MarkBench
MarkBench Game Settings
Keras-ocr wrapped in a Python HTTP API for MarkBench tests
 
We welcome your feedback!

I want to add another complaint about Volta Charger. In their latest update to their indiegogo supporters they've told us if we want a tracking number for our shipment we have to sign up for their "LATEST NEWS & OFFERS" mailing list. I should not have to be spammed by their marketing department just to receive a tracking number.

Hey,
 
This thread is focused on sponsor complaints related to personal product purchases, or first-hand experiences with one of LMG’s active sponsors. We will make every effort to help address these issues, but please note that we can’t respond to and help with everything, and some resolutions will take significant amounts of time to resolve. 
 
While LMG greatly appreciates and respects community input, we reserve the right to partner with the companies we feel right promoting. We'd like to thank everyone for all the support.

Hey everyone,
 
Please see below for our first weekly sponsor update! If you have any questions or concerns, we would advise centralizing feedback into our main "Sponsor Complaints" thread. That way we don't have to maintain updates across 52 of these weekly updates by this time next year. 
 
Secretlab
We're still keeping communication going with the folks over at Secretlab regarding the support service end of their products. We don’t have any new information to share at this time, but we will keep the dialogue going.
 
Volta
We saw there was an additional Volta post. We apologize for any issues people are experiencing, and we want to clarify that we’re no longer partnered with them.
 
BuildRedux
Regarding the RMA issue posted earlier this week, we'll see if we can be put in contact with their customer support in case there are larger issues with their RMA process. This is a partnership that Geoff oversees, so he may be in contact with the poster next week to gather some additional information regarding the shipping of the label if needed. While we have no reason to believe they're using parts previously used for mining, perhaps we need to check in on their RMA policy to make sure delays aren't their standard.
 
Anker
I believe we are at day 225 or so of asking to be taken off all of their sites. We were removed from taken off their primary landing page last week, but we are still waiting and requesting to be removed from their different Amazon pages as well. Our team was in contact with Anker as of Tuesday about the matter, and we will keep everyone updated.
 

We recently posted our sponsor "Do Not Work With" list here on the forum, and will be updating it as needed. We think it's important that our audience better understand our processes for vetting new sponsors.

Part of that process is vetting through the community. We regularly post potential sponsors on the board to see if any one of you has experience with the different brands that reach out to us, and we take that into consideration before engaging. Ideally we'd love to get every single item in to try it firsthand, but time and manpower doesn't always allow for that, so it's important for us to get a temperature check on something before having it brought in to try or test.

Thanks for reading this, and thanks for your fairness and patience while we work with our different partners to try to better the field as a whole.

Until next Friday!

Hey,
 
Please see below for a list of product verticals that we don't work with. Please note this list is subject to change.
 
Drugs / Alcohol
We do not believe this is responsible for us to promote at this time.
 
Crypto / NFT’s / ICO’s
Many of our team members believe crypto has long-term potential, but the market is largely unregulated and flooded with scams and people/groups with your worst interest in mind. This is not a field we want to get mixed up in at this time.
 
Credit Loans
Large life decisions like taking out loans is not between us and our audience. We are not financial advisors. We have worked with banks in the past who offer these types of services, but we want to avoid promoting them directly at this time.
 
Drop Shipping as a Service
“Drop shipping” simply means listing an item that is available from another source. There’s nothing inherently wrong with a retailer listing a product that’s in stock at their supplier’s warehouse… HOWEVER there is a growing industry that offers to help individuals set up their own drop shipping business with basically no standards for the quality of the service and products. 
After our initial fact-finding, we worked with one of these companies in 2023, but based on community feedback we don’t plan to again.
 
Gaming Chairs that don’t prioritize ergonomics 
The market is oversaturated, and only continues to be flooded with low quality lookalikes. We will continue to use our discretion when entering into partnerships with chair companies and closely monitor our community’s feedback.  
Mental Health/Therapy
We are pro therapy and advise anyone reading this to prioritize their mental health. With that being said, we would hate for someone's mental health to be negatively impacted by a bad experience with a service that we promoted. We do not intend to promote any companies who profit from these services at this time.
 
Online Sport Betting
We do not believe this is responsible for us to promote at this time.
 
Gambling (More Broadly)
We do not believe this is responsible for us to promote at this time.
 
Pay-2-Win Games
Many free to play games can be predatory. We test mobile games to see if that game can be enjoyed without the NEED to sink money into it. We know this is a fine line, but with our community’s feedback we believe we can separate the bad from the ones that are safe for partnership.
Eg. Diablo Immortal (On Launch) = Bad. Genshin Impact = Not Bad
 
Unproven Kickstarters / Indiegogo Campaigns
We’ve simply seen too many issues with false promises and delivery issues from first-time campaigners. We DO, however, understand that for some companies crowd funding is more of a marketing and demand-evaluation exercise, so we have worked with companies who have had successful campaigns or product launches in the past and our intention is to continue doing so.
 

The Labs guy was right. They plan to rerun all the comps every time, which no one, including GN, is doing. Steve himself has said they should rerun the comp tests with upgraded drivers but they won’t bother. You don’t even know the labs guy’s name, let alone his CV, so obviously you are a great source of who is reliable and who isn’t. Steve and GN have fucked up their fair amount of stuff too.,

With all due respect, while I agree there is nothing more to be said about this until Linus, Steve, or Billet make another statement, this isn't over.

The Billet Labs situation seems to be getting resolved so there is no issue there but we are still lacking 2 things.
 
We need to know how this happened in the first place. A proper explanation of how this happens will show that LMG is actually aware of how this complete system failure occurred. We need a path forward on what the plan is to prevent this from happening again. Once we have that I will personally consider this resolved. An apology won't do it, and ignoring it until it goes away certainly won't do it.

They give a disclaimer before any labs data they present that it is still a work in progress. 
 
It’s shitty, but all the investment in Labs has to cash flow. The burn rate for cash on the labs has to be massive with all the real property, logistics, and staff involved so they have to start monetizing it asap. It sucks but it is a business reality.

Not when this video is already rendered with more than 100% playback (Steve is like a MC getting ready to duke it out with his words in this video). 

From an optics perspective, does that actually matter though? Specifically when there are no LMG shareholders outside of Linus and Yvonne? 

Steve vs Linus cage match when?????

Many of the points made by GN are very valid I love LTT and there videos and I know the release a bunch of very good content, but there team is Huge now and given the concept of the lab I think its time they spend a little more time on accuracy, and making sure content is correct before posting, I just hope everyone can remain mature and take on bored the points of GN, and see it as GN trying to help LTT rather than just throwing shade and causing drama

For the large majority, GN is correct. The thing that sticks out to me has been the extremely large increase in * corrections. * this and * that. They need to let their foot off the gas a little. They're moving too fast and breaking things too quickly, catch my drift?
 
However, in my personal opinion, part of the video, in regard to sponsorship, seemed a bit more personally driven, rather than fact-based. But besides that, LTT needs to ensure accurate data. I will 100% back that. 
 
Hopefully, Linus and LTT will take a moment to reflect before rushing to any statements or any off-handed remarks on the WAN show on Friday. 

Maybe you should watch the entire video with the full reasoning before cementing your opinion

Considering the amount of work that will need, and allegations of being bought by manufacturers already, doesn't seem that feasible. It would require starting thats like Mac Address. With 1-3 writers/reviewers/hosts and 1-2 camera/editors. Not like with SC or Gamelinked where content is close enough for main channel to be able to use existing staff.
 
The glances (I mainly only listen SC content) I've had when they do car stuff also makes me cringe a bit. Reviews are done on public streets. While this might not be issue, the bigger channels will have advantage of doing safer and more professional reviews. With track testing (safer to test high-speeds, cornering etc.). I'm pretty sure LMG had got couple of notes from local police already for filming while driving (when camera is on dashboard or cameraperson is sitting next to driver). So if they take this move onwards, quality and safety should be top 1 priority.

Internally there are a number of people who really want a car channel, but the plate is so full right now that it is unlikely in the near future.

I didn't initially agree with the others for 17in version.
 
But the comments are right. LTT making products for niche tech use cases makes sense. Make it the whale 🐳 bag.
 
I assume you will fit the MacBook / Framework sizes. I don't know what kinds of models 17in laptops are made for nowadays but they are probably beefy.
 
 
Still prefer a messenger bag instead of a separate steam Deck and laptop bags. That seems wasteful. A 16in laptop and steam Deck or switch should fit in the tech messenger bag. Charger, mouse pockets are welcome. Along with other tech specific features.
 
Three sizes 14in, 16in, 18in jumbo version.
 

I'd prefer if you combined the Steam Deck bag and Laptop bag into a proper messenger/sling bag.

I'd prefer if you combined the Steam Deck bag and Laptop bag into a proper messenger/sling bag.

I didn't initially agree with the others for 17in version.
 
But the comments are right. LTT making products for niche tech use cases makes sense. Make it the whale 🐳 bag.
 
I assume you will fit the MacBook / Framework sizes. I don't know what kinds of models 17in laptops are made for nowadays but they are probably beefy.
 
 
Still prefer a messenger bag instead of a separate steam Deck and laptop bags. That seems wasteful. A 16in laptop and steam Deck or switch should fit in the tech messenger bag. Charger, mouse pockets are welcome. Along with other tech specific features.
 
Three sizes 14in, 16in, 18in jumbo version.
 

bro are you tryna bring back laptop bags? wtf lmao. 
you should make it so you can throw it at the ground and the laptop wont break. thats my only exp with laptop bags is that they are thin crap with little padding to make them take up less space and weigh less back when laptops weighed like 8lbs. 
but we as humans have moved beyond that and just carry laptop around in hand now because they are not heavy and dont need a charger every 30 minutes. So you may as well give a reason to use one, ie durability/protection.