Search the Community
Showing results for tags 'data science'.
-
Budget (including currency): under $500 CAD but open to suggestions Country: Canada Games, programs or workloads that it will be used for: Data Science, light gaming (rocket league, CS, Dota, Brawlhalla, etc.) Other details Current specs: Ryzen 7 2700 GTX 1070 B450M Pro4 32 GB RAM (8x4) EVGA 650w 80+ Gold I’m looking to get into Data Science where I work with AI/ML. The RTX Cards have Tensor Cores which I think might be beneficial for when I explore Deep Learning. I also do a bit of light gaming on the side (can’t really find a lot of time these days) just 1080p 144hz with a secondary monitor just running at 1080p 60hz. Which GPU should I buy? I’m thinking of upgrading my CPU later down the line to the Ryzen 7 5800X3D so I don’t want a GPU that will bottleneck that. Any suggestions?
-
Budget (including currency): 2500 Country: USA Games, programs or workloads that it will be used for: computing large data sets through Alteryx Other details https://newegg.io/d0af2fe Current build is: CPU: I7 13700k Mobo: Gigabyte Z690I Ram: Corsair Vengeance 64GB kit at 5200 GPU: MSI Ventus 3060 12GB (Biggest question is on the GPU. I've read a few articles that say for data science the gpu's cudda cores aren't as important as the base clocks of the ram and cpu. Additionally from my research Alteryx doesn't support the use of a gpu to assist with calculating, so this would be for other programs that may allow it in the future.) Case: Fractal Design node 202 PSU: Seasonic Focus SGX-650, 650w (this is based that the idea that I will probably remove/downgrade the GPU) Storgae: 1x XPG SX6000 128 GB lite (Boot drive) and 1x Crucial P3 4TB (his data sets are regularly over 20 gigs. He currently has 15ish gigs terabytes worth on external hard drives, so this would be for the more important sets so he can quickly access them.) CPU fan: Noctua NH-L9i 17xx My current concerns are the necessity of the GPU and if the 3060 is even worth it for a data machine like this, and additional cooling. I was reading some of the reviews for the case and they talked about cutting additional hole in the case which I'm perfectly comfortable doing. Thank you for all the help! - Collin
- 4 replies
-
- data
- data science
-
(and 2 more)
Tagged with:
-
Budget (including currency): 3000 Country: USA Games, programs or workloads that it will be used for: Computational chemistry research, specifically Maple, GAMESS, Gaussian, TensorFlow, Python, PyTorch Other details (existing parts lists, whether any peripherals are needed, what you're upgrading from, when you're going to buy, what resolution and refresh rate you want to play at, etc): Hello everyone, my wife was recently hired to become a professor of Chemistry and is looking to put together a workstation. While she will have some access to supercomputers, she would like to be able to do as much of her work locally as possible. While she has been able to talk to some advisors, none are super knowledgeable about PC hardware specifically, most just order what Dell tells them to. Her work uses the above programs and has an emphasis on machine learning and electronic structure theory. While she does have a budget up to $3,000, she also doesn't want to overspend on anything, so feel free to let us know if something seems overkill to you. The PCPartPicker list is below, thanks in advance for any help! PCPartPicker Part List: https://pcpartpicker.com/list/6KCWVw CPU: Intel Core i9-13900K 3 GHz 24-Core Processor ($549.97 @ Newegg) CPU Cooler: Noctua NH-D15 chromax.black 82.52 CFM CPU Cooler ($119.95 @ Amazon) Motherboard: Gigabyte Z790 AORUS ELITE AX ATX LGA1700 Motherboard ($254.99 @ Amazon) Memory: Corsair Vengeance 64 GB (2 x 32 GB) DDR5-5200 CL40 Memory ($164.99 @ Amazon) Storage: Samsung 980 Pro 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive ($129.99 @ Adorama) Video Card: Asus TUF GAMING GeForce RTX 4080 16 GB Video Card ($1199.00 @ Amazon) Case: Fractal Design Pop Air ATX Mid Tower Case ($105.98 @ Newegg) Power Supply: SeaSonic PRIME Ultra Platinum 1000 1000 W 80+ Platinum Certified Fully Modular ATX Power Supply ($408.97 @ Amazon) Total: $2933.84 Prices include shipping, taxes, and discounts when available Generated by PCPartPicker 2023-06-12 18:36 EDT-0400
-
Hello everyone, I am looking for a new laptop to buy around the 1400 euro range (+-200) which I will use mainly for work (as a data scientist) but also want the possibility to game on it (not games with the highest requirements ofc). Do you have any suggestions? I have been looking at things like the Inspiron 16 Plus Laptop (Intel® Core™ i7-11800H, 32GB RAM, GeForce RTX™ 3060), or the ASUS Vivobook Pro 16X OLED (AMD Ryzen™ 7 5800H, 16GB RAM, GeForce® RTX 3050 Ti), however I am out of the loop as to which CPU's/GPU's are better in what context so feel free to suggest any other combinations (such as AMD GPUs) or laptops that you would think are best. Thank you very much for your suggestions PS. I live in Germany so some prices may differ from the US market.
-
Hi, I am a software engineer/data-scientist/AI researcher with low hardware experience. But I have a difficult problem to solve and I need your expertise. I need to build a SINGLE server to do large-scale real-time analytics over tens of TBs of data. And the system should be expandable, as I want to add more HDDs and expansion cards in the future. What I have come up until now is a 60 drive JBOD, connected to the main server with 4 SAS cables. Now things get tricky. Buying a good server is extremely expensive. Furthermore, if you need GPUs to accelerate your apps, then you are limited to fanless Tesla cards, as only they can fit into most servers... So I want to build my own server. My concept. 16 RAM slots or more. I want to put 4x16Gb sticks on start and add some more later. The final desired RAM amount is ~300Gb. 2 sockets. Most likely LGA-2011v3/4. I need something with hyperthreading and at least 8 cores per socket. Most likely it will be Xeon E5-2620. They are not too old and not very expensive. 4 or more PCI-E Gen3 x8 or x16. 4U/5U chassis to fit all of that. 2 mid range GPUs on the start (GTX 1060) plus 2 top level cards in the future. Teslas are too expensive for me and I don’t need features like double precision. On the other hand, I need CUDA support, so AMD is not availiable. 4 or more SAS2 ports. Hardware SAS RAID controller. 1 PCI-E boot drive, probably in M.2 form factor. A small one ~100Gb. In future I plan to add some SATA3 SSDs as temporary buffer for my computations. 12 Toshiba P300 3Tb consumer-grade HDDs in RAID10 for JBOD. I know they are not recommended for such use, but they are many times cheaper then server-grade analogs and seem to be very reliable from what I have seen. I want this to be a single system make it easier for me to deploy my software. The people I normally ask insist on buying multiple small servers instead of one super-computer. But that will result in significant performance drop, as my software leverages all the benefits of many-core systems. I am ready for regular drive failures, but can’t afford SAS or SSDs at the moment. Futhermore, Linus had reached astonishing speeds with 45Drives NAS, so I hope to get the same. I am also considering single-socket solutions, but old CPUs don’t provide required amount of PCI-E lanes and Epycs by AMD are too expensive. Software. I plan to put Ubuntu 16 and ZFS. I have looked through RedHat/Debian options, but their community is not so big and I will definetly have to do some hacking to put everything together... Furthermore, it seems to be a reasonable choice for a server with some workstation-like loads. I have checked out BtrFS, unRAID and some orhers, but they have several problems in my use cases. More details. I currently live in Russia and getting new products from foreign online stores is complicated, as you never know when to expect your delivery. Furthermore, after the customs final price grows 50%. Furthermore, the used/refurbished consumer electronics market is incredibly small in Russia, so buying such parts to make the build cheaper is not an option. Also, in Russia we don’t have a good customer support, so making mistakes and changing parts is expensive. This machine will be working at home, so I need low power consumption. I do research in this area the last 4 weeks and my time runs out. I have to make a decision as soon as possible and hope to get the support of the community. I plan to publish the benchmarks once I build the system!  My current plan includes following devices. ⁃ https://www.asus.com/us/Commercial-Servers-Workstations/Z10PED1610G2T/specifications/ ⁃ https://www.newegg.com/Product/Product.aspx?Item=N82E16822149633 ⁃ http://www.chenbro.com/en-global/products/RackmountChassis/4U_Chassis/RM43260 ⁃ https://ark.intel.com/products/92986/Intel-Xeon-Processor-E5-2620-v4-20M-Cache-2_10-GHz My questions. Will it be possible to find an appropriate case for such a beast? I want the motherboard to be placed horizontally. Is it too bad to leave this machine without a case? With only the fans on CPUs and GPUs? How much power supply would you put in this server? JBOD has its own already. Will such cooler fit the socket? Technically it should, but it doesn’t include “xeons” in supported CPUs list. Can I put 2 of them together? Whats the best cooler I can safely put in here? I don’t want water cooling, as its very fragile. Will the RAID card handle RAID10 on 60 drives? Linus had covered the read speeds of a similar JBOD and sequential write speeds in the “Petabyte project”. They are 1x2.5 GB/s and 0.5 GB/s. But what about random write speeds? Such load is specific to databases. How often will such disks fail? I plan to partition all 60 drives into 5x12 RAID10 groups. Is there a better option for me if I want to pay under 7000USD on the start? Cloud computing is not an option. Is there a way to tune JBOD HDDs to work with low speeds to extend their lifetime? I know I can change head parking time with certain utils, but not sure if its the best I can do. How long I should expect those drives to work? Is there a way to make the NAS less noisy without switching to flash? Considering I load only 12 bays in the beginning. How insane is the entire plan? Is there a chance it will work? How else I can accomplish what I need? I have 3 more computers (macs) and I want them to connect to the database on this server to run some additional analytics as fast as possible... 2 of them have thunderbolt 1 and one has thunderbolt 3. So its speed is 40Gbits/s. How would you connect them if you were me? Thunderbolt to 10Gb Ethernet? PCI-E Thunderbolt expansion card? Another server as a network switch? Thanks in advance!
-
Hey Everyone, I am currently in my a sophomore in my sophomore and pursuing Computer Science and Engineering. As summer is approaching, i have a goal to learn Data Science and all related aspects and become proficient in Machine Learning and Data Science. I know this might not be the right forum to discuss this but as a community, i see this place is filled with pretty talented people from all around the world. So i am looking for someone who has experience working with data science and is willing to help me up to figure out a path which i can take to utilize my summer in the most efficient way. Your suggestion are really welcome and would be of great help. P.S. I already tried pretty hard to look it up online but everything is pretty scattered and all of them go in different ways as well. P.P.S. I also want to develop my Data Structures and Algorithms, for which i regularly take part in competitive programming contests as well.
-
1. Budget & Location 1500 USD, Hyderabad (INDIA). Can increase the budget to $1800 and my current build on PCPartPicker list translates to almost same (as per Indian rupees conversion). Can buy from these places: https://www.amazon.in/ https://www.newegg.com/global/in-en http://mdcomputers.in/ https://www.flipkart.com/ 2. Aim No gaming No OCing 12-15 hours a day usage Browser is open with 10-15 tabs in each window and 2-4 separate windows Programming/Coding Using Jupyter Lab Data Science and Machine Learning Watching 1080p videos Streaming 1080p videos through YouTube etc. Surfing/Searching on internet. 3. Monitors I just use one monitor. 1080p will be fine. 4. Peripherals Already ordered Mouse+keyboard (Logitech MK200) 5. Why are you upgrading? I have a 10 years old computer, AMD Athlon II X3 440 and it struggles to run Jupyter Lab I mentioned above and sometimes CPU usage goes 100% and it becomes unresponsive for 10-20 min when it comes to opening video streaming sites like YouTube. Its PSU has died already and keyboard and mouse are dying too. This is my 4th keyboard because I do programming, hence lot of typing. Monitor got some 2 inches sized 3 circular black spots in left corner. Used it a lot. Antec 300 Case I have, its buttons, even though I have lubricated many times, have gotten extremely rough now. So want to just upgrade.
-
Budget (including currency): ₹ 50k-70k (appx. US$ 1000) Country: India Games, programs or workloads that it will be used for: Designing, Analysis, Rendering, Machine Learning, Deep Learning Other details (existing parts lists, whether any peripherals are needed, what you're upgrading from, when you're going to buy, what resolution and refresh rate you want to play at, etc): I am looking to build a rig that'll be used by me(a Data Analyst) and my brother(Mechanical Engg. student). As a first-timer, I wish to understand how might I go about selecting the right parts that would suit both our different needs and what would the recommended way to go about the build.
- 1 reply
-
- build
- data science
-
(and 3 more)
Tagged with:
-
Hey, so a teacher and friend approached me to help them build a PC, which will be used for Data Analytics and Science for a strtup, he asked me because he knows I know how to build a PC. It will mainly be used for R and Python, they gave me a $1100 budget (Windows +´Monitor + IO). Well, here´s the list: PCPartPicker part list: https://pcpartpicker.com/list/X7p64q Price breakdown by merchant: https://pcpartpicker.com/list/X7p64q/by_merchant/ CPU: AMD - Ryzen 5 2600X 3.6GHz 6-Core Processor ($219.89 @ B&H) Motherboard: ASRock - X470 Master SLI/AC ATX AM4 Motherboard ($129.99 @ Newegg) Memory: Corsair - Vengeance LPX 16GB (2 x 8GB) DDR4-3000 Memory ($159.97 @ Amazon) Storage: Western Digital - Black NVMe 250GB M.2-2280 Solid State Drive ($99.89 @ OutletPC) Storage: Seagate - BarraCuda 1TB 3.5" 7200RPM Internal Hard Drive ($42.89 @ OutletPC) Video Card: MSI - Radeon RX 560 - 1024 4GB AERO ITX Video Card ($149.99 @ Amazon) Case: Cougar - MX330-X ATX Mid Tower Case ($38.99 @ SuperBiiz) Power Supply: Corsair - CXM 550W 80+ Bronze Certified Semi-Modular ATX Power Supply ($38.98 @ Newegg) Monitor: Acer - G247HYU 23.8" 2560x1440 60Hz Monitor ($199.99 @ Amazon) Total: $1080.58 Prices include shipping, taxes, and discounts when available Generated by PCPartPicker 2018-07-14 17:51 EDT-0400 It´s my first time building a PC for this purpose, but since its for this type of work, so I want to know if its adequate. I want to clarify that the reason why I am going X470 is because of the Motherboard WiFi, Bluetooth, but above all, the AMD StoreMI Technology. I selected a Radeon GPU for their incredible computing power at reasonable prices, and since it is computing, apparently there is no benefit from a Quadro or a WX Card (according to a Game Dev I talked to). The SSD is NVMe instead of SATA because it appears to be beneficial for this type of work to have quick transers. P.S. I would love it if you could reccommend me cheap (but great) ATX Mid Tower Cases. I am in between a Cooler Master N400, N600, a Cougar MX 330-X or 330-G and the NZXT S340. It just needs two fans at the very least.
-
Looking for some guidance for a home office server with the following use Network storage: Music, photos etc Automated backups (specific folders, manual images) Automated data scraping (simple python scripts) SQL Server Offloading data processing. Not working with "big data" per se, but I do regularly consolidate several data sets (measures 2-4 GB in memory) and perform simple calculations after consolidation (ratios, counts, event returns, etc). I have had a few R scripts take >6 hrs to process taking up all the cores on my desktop (yes, I know that R is not the most efficient language, and I am working on re-coding in python/sql). Offloading Bayesian/ML models. I am thinking of implementing VM, so that if one thing crashes not everything will. I don’t need things to be done right away, just looking to offload so that I can keep working ahead or on something else on the main desktop. This will be a budget-ish build (all preliminary) Ryzen 5/7 16 to 32 GB memory SSD Boot in RAID ? (or no redundancy and have a backup image) 2x HD for Network Access Storage in RAID ? 2x HD for Backups in RAID ? Integrated graphics/low end GPU with option to upgrade once all the crypto in the world has been mined. So what are my questions? OS Recommendation (Windows v. Linux) Virtualization software recommendations (VirtualBox, VMware etc) SQL Server recommendation (SQLite, MySQL etc) Remote software recommendation Backup software recommendations What HD controller options should I consider (RAID 1/5, SAS vs SATA etc) Thanks in advance for your help,
-
I am new to the community and I deleted social media... looking for friends that shares same interest 0_o and also i don't really know what i'm doing here
-
Hi folks, I need a bit of help planning my new build. Let me say this up front: I'm a total newbie. I'm a programmer, but I know quite little about hardware beyond the basics, so please forgive me if I say stupid stuff. I have attempted to put together a system, but I'm not sure if it's any good. (I adapted it from Linus' 2017 holiday buyers guide). https://nl.pcpartpicker.com/list/NhDgtg At the very least I need to get the price down a little bit, but I'm not sure where to cut. As a brief note, while I'm planning now, it will be quite a while before I can actually build something anyway. So I'm thinking of waiting for the price of GPUs and memory to come down a bit, but I'm not sure if that is smart. Thoughts? 1. Budget & Location Budget wise, I'd like to spend around 2000€ though that's not a hard limit. I'm doing the build in the Netherlands although I am planning to take it with me when I move to the UK in October, so it is a bit of a tricky situation. Like I said, the build I listed goes over that quite a bit but I'm unsure where to cut. 2. Aim I'm starting an AI PhD in October. I do lots of programming, AI and data research. So to allocate things like debuggers and emulators that I'll need for simulations every now and then I expect to need quite a bit of memory and a good CPU, and quite a bit of screen real estate, and fast storage. A note about the CPU though, not everything I do is very good at parallelizing so I need good single core performance. I also do gaming and youtube watching etc. on the side. I usually play RPGs and other narrative stuff, but very rarely competitive stuff so bleeding edge stuff is not required, although I would like to be able to comfortably run modern titles if I want. I'm okay with sticking with 1080p for the time being though 1440 would be nice to have. I don't care about overclocking to be honest, the troubleshooting doesn't seem worth it to me. Upgradability is not my main concern to be honest, I don't plan on upgrading very frequently. As long as I can comfortably run my IDEs and emulators I'll be happy for a while and I don't really keep up with new game releases that much so I'm not really concerned about keeping up with new technology that much. Ideally, it would be a set-it-and-forget-it system, but I'm open to other opinions. 3. Monitors Like I mentioned before briefly, I'm going to need quite some screen real estate. I'm planning on getting 2 monitors for the time being, with maybe a 3rd in the future. I'm okay with the monitors being 1080p, but the more the merrier, right? Though I think I'd rather have a higher refresh rate than a higher resolution to be honest. I included two options on my list, but again, open to suggestions. 4. Peripherals For monitors see the previous point, but I don't really need that many other peripherals. I'll use my old mice and keyboard, which are really nice. Maybe I'll need some new speakers, though I could still use my old ones for that as well. I'll also need a Windows home licence. 5. Why are you upgrading? Mostly because I have wanted to build my own PC for a long time. I have an old PC with my parents that is still capable but she's 7 years old at the time of writing. I'm considering building the PC as a gift to myself for graduating from my masters and getting the PhD position. Like I said, I don't know a lot about hardware so please be constructive Thanks for the help y'all. Let me know if you need anything!
- 6 replies
-
- new pc
- first build
-
(and 3 more)
Tagged with: