HandymanHandy

i mean how do you know what they really get... linus has talked about how restricted his kids time with elecronics is a lot on the wan show

no

That would be a very low severity, so, no action.

Due tot the investigation they likely cannot speak on it for legal reasons.

they don't need to show us anything

I am really glad that Linus called out online abusers who harass people. Why people think that is ok is beyond me. 

Hey,
 
Please see below for a list of product verticals that we don't work with. Please note this list is subject to change.
 
Drugs / Alcohol
We do not believe this is responsible for us to promote at this time.
 
Crypto / NFT’s / ICO’s
Many of our team members believe crypto has long-term potential, but the market is largely unregulated and flooded with scams and people/groups with your worst interest in mind. This is not a field we want to get mixed up in at this time.
 
Credit Loans
Large life decisions like taking out loans is not between us and our audience. We are not financial advisors. We have worked with banks in the past who offer these types of services, but we want to avoid promoting them directly at this time.
 
Drop Shipping as a Service
“Drop shipping” simply means listing an item that is available from another source. There’s nothing inherently wrong with a retailer listing a product that’s in stock at their supplier’s warehouse… HOWEVER there is a growing industry that offers to help individuals set up their own drop shipping business with basically no standards for the quality of the service and products. 
After our initial fact-finding, we worked with one of these companies in 2023, but based on community feedback we don’t plan to again.
 
Gaming Chairs that don’t prioritize ergonomics 
The market is oversaturated, and only continues to be flooded with low quality lookalikes. We will continue to use our discretion when entering into partnerships with chair companies and closely monitor our community’s feedback.  
Mental Health/Therapy
We are pro therapy and advise anyone reading this to prioritize their mental health. With that being said, we would hate for someone's mental health to be negatively impacted by a bad experience with a service that we promoted. We do not intend to promote any companies who profit from these services at this time.
 
Online Sport Betting
We do not believe this is responsible for us to promote at this time.
 
Gambling (More Broadly)
We do not believe this is responsible for us to promote at this time.
 
Pay-2-Win Games
Many free to play games can be predatory. We test mobile games to see if that game can be enjoyed without the NEED to sink money into it. We know this is a fine line, but with our community’s feedback we believe we can separate the bad from the ones that are safe for partnership.
Eg. Diablo Immortal (On Launch) = Bad. Genshin Impact = Not Bad
 
Unproven Kickstarters / Indiegogo Campaigns
We’ve simply seen too many issues with false promises and delivery issues from first-time campaigners. We DO, however, understand that for some companies crowd funding is more of a marketing and demand-evaluation exercise, so we have worked with companies who have had successful campaigns or product launches in the past and our intention is to continue doing so.
 
VPNs
We used to partner with Private Internet Access, but they, among others, were acquired by a single holding company, leading to concerns about privacy and data. While we acknowledge the usefulness of VPNs and many members of our team use them - including PIA -  it’s hard for us to PUBLICLY back any specific VPNs given the fluidity of the landscape. Our intention is to just stay out of it for now.
 

A quick suggestion, you may be able to give MarkBench the ability to set the game settings on its own to avoid human error. A lot of games use generic text-based configuration files to store settings, and are easy to adjust from something like notepad. Almost anything based on Unreal, for example, can easily be adjusted with code, since it stores game settings in a couple of .ini files somewhere in appdata.

I know you guys are planning to do automation and lots of tools are involved. I think you should do something additional. First you need a log of historical data, second you need some option to enter what company promised. Enter your expectation. Then calculate the delta in the variation, this will help to an extent. I know automation is something that will ease things up. But for every benchmark. One random game/ tool etc need to be selected and do a manual testing without any tools, and see how it compares.

I know the Dota 2 arcade is wild but I had no idea Rocket League was in there lol.
 
Cool to see this stuff!!! Thank you for sharing, love the transparency and openness. Please keep it up!
 

F1 '23

Cyberpunk 2077 

cyberpunkProcedure_1.png cyberpunkProcedure_2.png

Hey folks. Long time lurker, first time poster. I've been the one to primarily work on documentation & data lifespan strategies for Labs, and I've been asked to share some of our internal processes. We've been primarily using an instance of Bookstacks to draft these on, but our plan was to migrate them to a QMS that I've been building in order to better track versions of our processes as they relate to test results we obtain. For the next few weeks, I'll be uploading some screenshots of these Bookstacks documents, and once we've started migrating to that QMS system, I'll be uploading .PDFs instead (which will also contain other things you might expect, like scope, equipment & resource requirements, and version controls). Those .PDFs will be eventually maintained on our website or GitHub as is appropriate, but we wanted to give you folks access to them immediately.
 
Some background on what you're looking at here might also be valuable. When it comes to game tests, we break them out into unique parameter strings in order to remove ambiguity throughout our data collection & analysis process. If you see something like 'Games-1080-Rt', then that means that it's:
A game-based test, Conducted at 1920x1080 Done using our ray-traced parameter set We collect all of these parameter sets on a per-game basis. That allows us to revise multiple slim files with changes as needed, instead of having a massive library of all of our game test parameters all in one file that would collect revisions like I collect Steam games. Today I'm releasing our current versions of both Cyberpunk and F1 '23, and I welcome your feedback on it. If you have questions about why we chose one setting over another or what parameter sets we're looking at next for a given game, then this is the thread for you. To start us off, here's a screenshot of the list of game tests we have and are actively working on, the majority of which are harnessed for use with Markbench (or in development for that step). 

As part of our transparency commitment to the community, we will upload our test procedures for both hardware and software-related items in this thread.  We are starting this process today (See the first reply to this post).
 
Our initial uploads will be in our Bookstack format and then we'll be converting to a version-controlled document for improved auditing and tracking purposes.  We expect to have the vast majority of processes uploaded in September.  And we will continue to provide uploads as we add new test processes and/or modify current processes.
 
Here are links to our testing repositories:
Test harnesses used in LTT Labs MarkBench
MarkBench Game Settings
Keras-ocr wrapped in a Python HTTP API for MarkBench tests
 
We welcome your feedback!

After thoroughly reviewing each LTT video containing Labs data or analysis, we have arrived at the following results.
Of the 32 videos reviewed, 25 contained Labs Test Data.   Of these 25 reviews, Labs has determined that in the T1 category, (2) videos should be removed until we can verify the results with a second test system.  We also determined that (2) videos contained charts that should be completely replaced after verification of the test results.  In the T2 category, Labs verified that the data is correct, but we have 24 corrections to make to 21 graphs that contain process errors on the charts.  Process errors included transposed numbers, numbers rounded incorrectly, incorrectly labelled tests/components and cross entry into the wrong charts.  These errors are being addressed with continuous process changes, including Labs taking over all charting responsibilities and hiring specialized personnel. We have noticed a significant drop in errors discovered and/or released over the past few weeks.  In the T3 category, we discovered eight typos that included reversed label descriptions and/or incorrect information like the number of PCIe lanes in a spec chart.  While these are pinned comments, we are working on correcting the videos for now.  As discussed in the video today, this post or workbook will not be updated. 

Internally this is a living document, and may change as we move forward, but as part of our push for further transparency, we are publishing it in its current form to help our community better-understand how we classify errors and what action we will be taking to rectify them.
 
Types of errors
Flubs: the host simply misspoke
Incongruencies: information within the video is not in agreement (e.g. host says “$45” while the product page shows “$47”
Bad spec: a table or MOGRT contains incorrect information (e.g. “48MB” instead of “96MB”
Bad data: a graph or visualization contains data (generated by us) that is erroneous, misplaced, or spurious. 
Bad info: a statement or representation in the video that is misleading or factually inaccurate
Types of error correction
Proactive (before the video is posted)
Video pickup: the segment is re-shot with both audio and video
Human audio pickup: new audio is recorded for the segment (visuals have coverage)
AI audio pickup: new voiceover is generated. In the best case this uses a voice model that sounds like the host. However, using a robot voice  can still work.
Text on screen: the editor overlays clarifying or correcting text
This will not be received by viewers who are not (or cannot) watching the screen
Reactive (after the video is posted)
Video Replace: replacing the video with a new version without re-uploading
This relies on YouTube and takes some time. There are fairly strict guidelines around the use of this tool and strong justification must be provided for all changes. This is preferred to a re-upload, but there is likely a soft-limit on how often we can use this resource.
Re-upload the video: Set the original, erroneous video to Private and upload a new version. This will have algorithmic effects, but must be done if replacement is not an option
Pinned comment: add a comment describing the correction. 
This will not be received by viewers who do not check the comments (common, especially for those watching on a Smart TV) and should only be used for low-severity errors.
 
Assessing & Responding to Errors
If any of the following types of errors are discovered prior to filming (e.g. during script review) , fix them before the shoot.
 
1. Very Low Severity
- The statement could possibly be misunderstood, but it’s generally true and most people would be fine with how it’s currently presented.
- eg. The host says, “One of DisplayPort’s main advantages over HDMI is its higher bandwidth,” but this is only true when comparing certain generations of the standards. HDMI 2.1, for example, has much higher bandwidth than DP 1.1.
 
Action: no action
 
2. Low Severity
- The statement is incorrect, and we should try to clarify it better in the future, but we can leave it for now because it doesn’t meaningfully impact a viewer’s purchase decision or general knowledge.
- eg. The host says, “This monitor features moderate pixel response times and contrast because it uses an IPS panel”, but the panel manufacturer is actually AUO, rather than LG, so it’s not an IPS panel - a term which is trademarked by LG - but rather an IPS-type or IPS-like panel.
 
Action: Pinned comment
Note: Pinned comment text must be approved by the Community Coordinator before being posted.
 
3. Medium Severity
- The statement is incorrect, and a minority of the audience could be upset or misled, even if it doesn’t really affect the outcome of the product evaluation for the majority.
- eg. The host says, “This GPU has AMD’s AMF video encoder, which is basically the same as NVIDIA’s NVENC,” but while the stated functionality is the same, NVENC offers better image quality, which could be important to a small minority of buyers.
 
Action: Video replaced if possible according to YouTube policy, otherwise pinned comment and above fold mention of the issue in the video description
If doing a video replace, a pinned comment should communicate this is coming and note the expected changes. This comment should be un-pinned when the video replace is complete. 
Note: Pinned comment text must be approved by the Community Coordinator before being posted.
 
4. High Severity
- The statement is incorrect, and a significant portion of the audience could be misled or make a poorly-informed purchase decision.
- eg. The host says, “This is a great gaming monitor,” when in fact, the monitor is a 60Hz VA display that, while ‘fine’ for playing games, lacks important gaming-centric features that could be easily had for the same price, making it a poor choice. 
 
Action: Video replaced if possible according to YouTube policy. Otherwise, set unlisted and disable monetization until corrective action can be taken. 
If doing a video replace, a pinned comment should communicate this is coming and note the expected changes. This comment should be un-pinned when the video replace is complete. 
Note: Pinned comment text must be approved by the Community Coordinator before being posted.
 
5. Very High Severity
- The statement is VERY incorrect—basically the opposite of correct. There is no charitable interpretation that could make this anything but completely irresponsible.
- ex. The host says, “Most games require only one high-performance core to perform their best,” when that hasn’t been true for over a decade.
 
Action: Video removed or remade

As promised, here is the thread where you can post your transparency suggestions for Labs. Here are some examples of things we'd like to see feedback about:
Ideas in our benchmarking. What you'd like to see regarding test system information. Benchmark details. Testbed variations. And, of course, any other transparency-related feedback is welcome, but similar to the Sponsor Complaints subforum, any off-topic comments will be subject to moderation.
 
Thank you for wanting to help us improve the way we do things here!

This is a brain dead take.

It is standard practice to reach out to the company for a comment or statement on an article published about them. GN even normally follows this practice.
 
IT IS WHY Linus called them out for it. If LTT refused or gave a BS statement, GN likely would have put it in the video and criticized it as such as they have in the past.
 
They didn't though, GN just blasted it out.

Getting all the details before publication is *NOT* the opposite of journalistic integrity.

This isn't about being on a side... There's no war. You don't need to fight. You need to slow down and think.... 

Summary
An ex-Ubiquiti engineer, Nickolas Sharp, was sentenced to six years in prison yesterday after pleading guilty in a New York court to stealing tens of gigabytes of confidential data, demanding a $1.9 million ransom from his former employer, and then publishing the data publicly when his demands were refused.
 
Quotes
 
My thoughts
This was coming for him. More than this, he even tried to feed this fake breach info to Krebs on Security who wrote multiple articles defaming Ubiquiti causing their stock to tumble as per their own words. I remember this was discussed last year in WAN show when this came out, so I hope we get to see final thoughts of Linus and Luke on WAN show on this final news.
 
Sources
https://arstechnica.com/tech-policy/2023/05/ex-ubiquiti-engineer-behind-breathtaking-data-theft-gets-6-year-prison-term/

Ubiquiti isn't perfect as a company or a brand but... this guy... EUGH this guy. 
 
I prefer a less is more approach to criminal justice but I'm glad he's going to have time to think about why leaking million's of peoples' data is bad. 

Lol what a newb:
 
That's what this button is for on my VPN so you don't leak your shit if it disconnects. 

There is no legitimate reason to block ads on a site that isn't a garbage site. Block ads on garbage sites, because those are sites peddle in stolen content anyway. Blocking ads on youtube is just being a spiteful jerk.

I dont know why people expect free services that cost money to serve you. to not just be free, but ad-free. 

Youtube has never been egregious with ads, some creators sure, but not youtube itself, and premium is cheap.